Nov 13 20:28:20 user nova-compute[75239]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75239) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 20:28:20 user nova-compute[75239]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75239) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 20:28:20 user nova-compute[75239]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75239) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 20:28:20 user nova-compute[75239]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.029s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:28:21 user nova-compute[75239]: INFO nova.virt.driver [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 13 20:28:21 user nova-compute[75239]: INFO nova.compute.provider_config [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] Acquiring lock "singleton_lock" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] Acquired lock "singleton_lock" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] Releasing lock "singleton_lock" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] Full set of CONF: {{(pid=75239) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ******************************************************************************** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] Configuration options gathered from: {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ================================================================================ {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] allow_resize_to_same_host      = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] arq_binding_timeout            = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] backdoor_port                  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] backdoor_socket                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] block_device_allocate_retries  = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] block_device_allocate_retries_interval = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cert                           = self.pem {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute_monitors               = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] config_dir                     = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] config_drive_format            = iso9660 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] config_source                  = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] console_host                   = user {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] control_exchange               = nova {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cpu_allocation_ratio           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] daemon                         = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] debug                          = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] default_access_ip_network_name = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] default_availability_zone      = nova {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] default_ephemeral_format       = ext4 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] default_green_pool_size        = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] default_schedule_zone          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] disk_allocation_ratio          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] enable_new_services            = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] enabled_apis                   = ['osapi_compute'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] enabled_ssl_apis               = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] flat_injected                  = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] force_config_drive             = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] force_raw_images               = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] graceful_shutdown_timeout      = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] heal_instance_info_cache_interval = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] host                           = user {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] instance_build_timeout         = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] instance_delete_interval       = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] instance_format                = [instance: %(uuid)s]  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] instance_name_template         = instance-%08x {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] instance_usage_audit           = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] instance_usage_audit_period    = month {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] internal_service_availability_zone = internal {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] key                            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] live_migration_retry_count     = 30 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] log_config_append              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] log_dir                        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] log_file                       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] log_options                    = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] log_rotate_interval            = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] log_rotate_interval_type       = days {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] log_rotation_type              = none {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] long_rpc_timeout               = 1800 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] max_concurrent_builds          = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] max_concurrent_live_migrations = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] max_concurrent_snapshots       = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] max_local_block_devices        = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] max_logfile_count              = 30 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] max_logfile_size_mb            = 200 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] maximum_instance_delete_attempts = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] metadata_listen                = 0.0.0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] metadata_listen_port           = 8775 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] metadata_workers               = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] migrate_max_retries            = -1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] mkisofs_cmd                    = genisoimage {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] my_ip                          = 10.0.0.210 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] network_allocate_retries       = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] osapi_compute_listen_port      = 8774 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] osapi_compute_unique_server_name_scope =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] osapi_compute_workers          = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] password_length                = 12 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] periodic_enable                = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] periodic_fuzzy_delay           = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] pointer_model                  = ps2mouse {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] preallocate_images             = none {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] publish_errors                 = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] pybasedir                      = /opt/stack/nova {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ram_allocation_ratio           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] rate_limit_burst               = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] rate_limit_except_level        = CRITICAL {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] rate_limit_interval            = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] reboot_timeout                 = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] reclaim_instance_interval      = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] record                         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] reimage_timeout_per_gb         = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] report_interval                = 120 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] rescue_timeout                 = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] reserved_host_cpus             = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] reserved_host_disk_mb          = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] reserved_host_memory_mb        = 512 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] reserved_huge_pages            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] resize_confirm_window          = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] resize_fs_using_block_device   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] resume_guests_state_on_host_boot = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] rpc_response_timeout           = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] run_external_periodic_tasks    = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] running_deleted_instance_action = reap {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] running_deleted_instance_poll_interval = 1800 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] running_deleted_instance_timeout = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler_instance_sync_interval = 120 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_down_time              = 720 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] servicegroup_driver            = db {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] shelved_offload_time           = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] shelved_poll_interval          = 3600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] shutdown_timeout               = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] source_is_ipv6                 = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ssl_only                       = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] state_path                     = /opt/stack/data/nova {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] sync_power_state_interval      = 600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] sync_power_state_pool_size     = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] syslog_log_facility            = LOG_USER {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] tempdir                        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] timeout_nbd                    = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] transport_url                  = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] update_resources_interval      = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] use_cow_images                 = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] use_eventlog                   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] use_journal                    = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] use_json                       = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] use_rootwrap_daemon            = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] use_stderr                     = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] use_syslog                     = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vcpu_pin_set                   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plugging_is_fatal          = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plugging_timeout           = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] virt_mkfs                      = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] volume_usage_poll_interval     = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] watch_log_file                 = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] web                            = /usr/share/spice-html5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_concurrency.disable_process_locking = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.auth_strategy              = keystone {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.compute_link_prefix        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.dhcp_domain                = novalocal {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.enable_instance_password   = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.glance_link_prefix         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.instance_list_per_project_cells = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.list_records_by_skipping_down_cells = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.local_metadata_per_cell    = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.max_limit                  = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.metadata_cache_expiration  = 15 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.neutron_default_tenant_id  = default {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.use_forwarded_for          = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.use_neutron_default_nets   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.vendordata_dynamic_targets = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.vendordata_jsonfile_path   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.backend                  = dogpile.cache.memcached {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.backend_argument         = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.config_prefix            = cache.oslo {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.dead_timeout             = 60.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.debug_cache_backend      = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.enable_retry_client      = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.enable_socket_keepalive  = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.enabled                  = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.expiration_time          = 600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.hashclient_retry_attempts = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_dead_retry      = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_password        =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_pool_maxsize    = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_sasl_enabled    = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.memcache_username        =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.proxies                  = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.retry_attempts           = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.retry_delay              = 0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.socket_keepalive_count   = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.socket_keepalive_idle    = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.socket_keepalive_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.tls_allowed_ciphers      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.tls_cafile               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.tls_certfile             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.tls_enabled              = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cache.tls_keyfile              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.auth_section            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.auth_type               = password {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.cafile                  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.certfile                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.collect_timing          = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.cross_az_attach         = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.debug                   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.endpoint_template       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.http_retries            = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.insecure                = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.keyfile                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.os_region_name          = RegionOne {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.split_loggers           = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cinder.timeout                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.cpu_dedicated_set      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.cpu_shared_set         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.image_type_exclude_list = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.max_concurrent_disk_ops = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.max_disk_devices_to_attach = -1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.resource_provider_association_refresh = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.shutdown_retry_interval = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] conductor.workers              = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] console.allowed_origins        = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] console.ssl_ciphers            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] console.ssl_minimum_version    = default {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] consoleauth.token_ttl          = 600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.cafile                  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.certfile                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.collect_timing          = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.connect_retries         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.connect_retry_delay     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.endpoint_override       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.insecure                = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.keyfile                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.max_version             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.min_version             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.region_name             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.service_name            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.service_type            = accelerator {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.split_loggers           = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.status_code_retries     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.status_code_retry_delay = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.timeout                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] cyborg.version                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.backend               = sqlalchemy {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.connection            = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.connection_debug      = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.connection_parameters =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.connection_recycle_time = 3600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.connection_trace      = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.db_inc_retry_interval = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.db_max_retries        = 20 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.db_max_retry_interval = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.db_retry_interval     = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.max_overflow          = 50 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.max_pool_size         = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.max_retries           = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.mysql_wsrep_sync_wait = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.pool_timeout          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.retry_interval        = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.slave_connection      = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] database.sqlite_synchronous    = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.backend           = sqlalchemy {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.connection        = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.connection_debug  = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.connection_parameters =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.connection_recycle_time = 3600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.connection_trace  = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.db_inc_retry_interval = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.db_max_retries    = 20 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.db_max_retry_interval = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.db_retry_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.max_overflow      = 50 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.max_pool_size     = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.max_retries       = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.pool_timeout      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.retry_interval    = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.slave_connection  = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] api_database.sqlite_synchronous = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] devices.enabled_mdev_types     = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ephemeral_storage_encryption.enabled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.api_servers             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.cafile                  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.certfile                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.collect_timing          = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.connect_retries         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.connect_retry_delay     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.debug                   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.default_trusted_certificate_ids = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.enable_certificate_validation = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.enable_rbd_download     = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.endpoint_override       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.insecure                = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.keyfile                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.max_version             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.min_version             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.num_retries             = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.rbd_ceph_conf           =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.rbd_connect_timeout     = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.rbd_pool                =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.rbd_user                =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.region_name             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.service_name            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.service_type            = image {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.split_loggers           = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.status_code_retries     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.status_code_retry_delay = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.timeout                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.verify_glance_signatures = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] glance.version                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] guestfs.debug                  = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.config_drive_cdrom      = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.config_drive_inject_password = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.enable_instance_metrics_collection = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.enable_remotefx         = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.instances_path_share    =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.iscsi_initiator_list    = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.limit_cpu_features      = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.power_state_check_timeframe = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.use_multipath_io        = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.volume_attach_retry_count = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.vswitch_name            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] mks.enabled                    = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] image_cache.manager_interval   = 2400 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] image_cache.precache_concurrency = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] image_cache.remove_unused_base_images = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] image_cache.subdirectory_name  = _base {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.api_max_retries         = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.api_retry_interval      = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.auth_section            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.auth_type               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.cafile                  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.certfile                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.collect_timing          = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.conductor_group         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.connect_retries         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.connect_retry_delay     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.endpoint_override       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.insecure                = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.keyfile                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.max_version             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.min_version             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.peer_list               = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.region_name             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.serial_console_state_timeout = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.service_name            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.service_type            = baremetal {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.split_loggers           = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.status_code_retries     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.status_code_retry_delay = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.timeout                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ironic.version                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] key_manager.fixed_key          = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.barbican_api_version  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.barbican_endpoint     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.barbican_endpoint_type = public {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.barbican_region_name  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.cafile                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.certfile              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.collect_timing        = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.insecure              = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.keyfile               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.number_of_retries     = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.retry_delay           = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.send_service_user_token = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.split_loggers         = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.timeout               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.verify_ssl            = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican.verify_ssl_path       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican_service_user.auth_section = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican_service_user.auth_type = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican_service_user.cafile   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican_service_user.certfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican_service_user.collect_timing = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican_service_user.insecure = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican_service_user.keyfile  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican_service_user.split_loggers = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] barbican_service_user.timeout  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.approle_role_id          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.approle_secret_id        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.cafile                   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.certfile                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.collect_timing           = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.insecure                 = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.keyfile                  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.kv_mountpoint            = secret {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.kv_path                  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.kv_version               = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.namespace                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.root_token_id            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.split_loggers            = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.ssl_ca_crt_file          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.timeout                  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.use_ssl                  = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.auth_section          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.auth_type             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.cafile                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.certfile              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.collect_timing        = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.connect_retries       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.connect_retry_delay   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.endpoint_override     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.insecure              = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.keyfile               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.max_version           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.min_version           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.region_name           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.service_name          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.service_type          = identity {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.split_loggers         = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.status_code_retries   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.status_code_retry_delay = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.timeout               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] keystone.version               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.connection_uri         =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.cpu_mode               = custom {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: WARNING oslo_config.cfg [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.cpu_power_governor_high = performance {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.cpu_power_governor_low = powersave {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.cpu_power_management   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.device_detach_attempts = 8 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.device_detach_timeout  = 20 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.disk_cachemodes        = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.disk_prefix            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.enabled_perf_events    = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.file_backed_memory     = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.gid_maps               = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.hw_disk_discard        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.hw_machine_type        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.images_rbd_glance_store_name =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.images_rbd_pool        = rbd {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.images_type            = default {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.images_volume_group    = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.inject_key             = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.inject_partition       = -2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.inject_password        = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.iscsi_iface            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.iser_use_multipath     = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_bandwidth = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_downtime = 500 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_inbound_addr = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_permit_post_copy = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_scheme  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_timeout_action = abort {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_tunnelled = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: WARNING oslo_config.cfg [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 13 20:28:21 user nova-compute[75239]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 13 20:28:21 user nova-compute[75239]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 13 20:28:21 user nova-compute[75239]: and ``live_migration_inbound_addr`` respectively.
Nov 13 20:28:21 user nova-compute[75239]: ).  Its value may be silently ignored in the future.
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.live_migration_with_native_tls = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.max_queues             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.nfs_mount_options      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.num_memory_encrypted_guests = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.num_pcie_ports         = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.pmem_namespaces        = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.quobyte_client_cfg     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rbd_secret_uuid        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rbd_user               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.remote_filesystem_transport = ssh {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rescue_image_id        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rescue_kernel_id       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rescue_ramdisk_id      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.rx_queue_size          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.smbfs_mount_options    =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.snapshot_compression   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.snapshot_image_format  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.sparse_logical_volumes = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.swtpm_enabled          = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.swtpm_group            = tss {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.swtpm_user             = tss {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.sysinfo_serial         = unique {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.tb_cache_size          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.tx_queue_size          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.uid_maps               = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.use_virtio_for_bridges = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.virt_type              = kvm {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.volume_clear           = zero {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.volume_clear_size      = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.volume_use_multipath   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.vzstorage_cache_path   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.vzstorage_mount_user   = stack {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.auth_section           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.auth_type              = password {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.cafile                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.certfile               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.collect_timing         = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.connect_retries        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.connect_retry_delay    = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.default_floating_pool  = public {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.endpoint_override      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.extension_sync_interval = 600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.http_retries           = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.insecure               = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.keyfile                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.max_version            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.min_version            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.ovs_bridge             = br-int {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.physnets               = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.region_name            = RegionOne {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.service_metadata_proxy = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.service_name           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.service_type           = network {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.split_loggers          = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.status_code_retries    = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.status_code_retry_delay = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.timeout                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] neutron.version                = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] notifications.bdms_in_notifications = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] notifications.default_level    = INFO {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] notifications.notification_format = unversioned {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] notifications.notify_on_state_change = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] pci.alias                      = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] pci.device_spec                = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] pci.report_in_placement        = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.auth_section         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.auth_type            = password {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.cafile               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.certfile             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.collect_timing       = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.connect_retries      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.connect_retry_delay  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.default_domain_id    = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.default_domain_name  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.domain_id            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.domain_name          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.endpoint_override    = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.insecure             = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.keyfile              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.max_version          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.min_version          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.password             = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.project_domain_id    = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.project_domain_name  = Default {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.project_id           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.project_name         = service {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.region_name          = RegionOne {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.service_name         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.service_type         = placement {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.split_loggers        = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.status_code_retries  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.status_code_retry_delay = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.system_scope         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.timeout              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.trust_id             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.user_domain_id       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.user_domain_name     = Default {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.user_id              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.username             = placement {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] placement.version              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.cores                    = 20 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.count_usage_from_placement = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.injected_file_content_bytes = 10240 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.injected_file_path_length = 255 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.injected_files           = 5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.instances                = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.key_pairs                = 100 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.metadata_items           = 128 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.ram                      = 51200 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.recheck_quota            = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.server_group_members     = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] quota.server_groups            = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] rdp.enabled                    = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.image_metadata_prefilter = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.max_attempts         = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.max_placement_results = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.query_placement_for_image_type_support = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] scheduler.workers              = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.host_subset_size = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.isolated_hosts = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.isolated_images = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.pci_in_placement = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.track_instance_changes = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] metrics.required               = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] metrics.weight_multiplier      = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] metrics.weight_setting         = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] serial_console.enabled         = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] serial_console.port_range      = 10000:20000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] serial_console.serialproxy_port = 6083 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.auth_section      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.auth_type         = password {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.cafile            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.certfile          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.collect_timing    = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.insecure          = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.keyfile           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.send_service_user_token = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.split_loggers     = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] service_user.timeout           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.agent_enabled            = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.enabled                  = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.html5proxy_port          = 6082 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.image_compression        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.jpeg_compression         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.playback_compression     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.server_listen            = 127.0.0.1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.streaming_mode           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] spice.zlib_compression         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] upgrade_levels.baseapi         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] upgrade_levels.cert            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] upgrade_levels.compute         = auto {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] upgrade_levels.conductor       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] upgrade_levels.scheduler       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vendordata_dynamic_auth.auth_section = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vendordata_dynamic_auth.auth_type = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vendordata_dynamic_auth.cafile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vendordata_dynamic_auth.certfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vendordata_dynamic_auth.insecure = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vendordata_dynamic_auth.keyfile = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vendordata_dynamic_auth.timeout = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.api_retry_count         = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.ca_file                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.cache_prefix            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.cluster_name            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.connection_pool_size    = 10 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.console_delay_seconds   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.datastore_regex         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.host_ip                 = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.host_password           = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.host_port               = 443 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.host_username           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.insecure                = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.integration_bridge      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.maximum_objects         = 100 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.pbm_default_policy      = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.pbm_enabled             = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.pbm_wsdl_location       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.serial_port_proxy_uri   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.serial_port_service_uri = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.task_poll_interval      = 0.5 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.use_linked_clone        = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.vnc_keymap              = en-us {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.vnc_port                = 5900 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vmware.vnc_port_total          = 10000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.auth_schemes               = ['none'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.enabled                    = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.novncproxy_port            = 6080 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.server_listen              = 0.0.0.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.vencrypt_ca_certs          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.vencrypt_client_cert       = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vnc.vencrypt_client_key        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.disable_rootwrap   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.enable_numa_live_migration = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.libvirt_disable_apic = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.client_socket_timeout     = 900 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.default_pool_size         = 1000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.keep_alive                = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.max_header_line           = 16384 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.ssl_ca_file               = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.ssl_cert_file             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.ssl_key_file              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.tcp_keepidle              = 600 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] zvm.ca_file                    = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] zvm.cloud_connector_url        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] zvm.reachable_timeout          = 300 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.enforce_new_defaults = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.enforce_scope      = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.policy_default_rule = default {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.policy_file        = policy.yaml {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.connection_string     = messaging:// {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.enabled               = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.es_doc_type           = notification {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.es_scroll_size        = 10000 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.es_scroll_time        = 2m {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.filter_error_trace    = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.hmac_keys             = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.sentinel_service_name = mymaster {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.socket_timeout        = 0.1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.trace_requests        = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler.trace_sqlalchemy      = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler_jaeger.process_tags   = {} {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler_jaeger.service_name_prefix = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] profiler_otlp.service_name_prefix = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] remote_debug.host              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] remote_debug.port              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.ssl      = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_notifications.retry = -1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_messaging_notifications.transport_url = **** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.auth_section        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.auth_type           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.cafile              = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.certfile            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.collect_timing      = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.connect_retries     = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.connect_retry_delay = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.endpoint_id         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.endpoint_override   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.insecure            = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.keyfile             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.max_version         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.min_version         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.region_name         = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.service_name        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.service_type        = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.split_loggers       = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.status_code_retries = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.status_code_retry_delay = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.timeout             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.valid_interfaces    = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_limit.version             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_reports.file_event_handler = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] oslo_reports.log_dir           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_ovs_privileged.group  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] vif_plug_ovs_privileged.user   = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_linux_bridge.flat_interface = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_ovs.isolate_vif         = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_vif_ovs.per_port_bridge     = False {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] os_brick.lock_path             = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] privsep_osbrick.capabilities   = [21] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] privsep_osbrick.group          = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] privsep_osbrick.helper_command = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] privsep_osbrick.user           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] nova_sys_admin.group           = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] nova_sys_admin.helper_command  = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] nova_sys_admin.user            = None {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG oslo_service.service [None req-cbcdd68c-e2f6-4382-a4f2-98af55c3709b None None] ******************************************************************************** {{(pid=75239) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 13 20:28:21 user nova-compute[75239]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 13 20:28:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Connecting to libvirt: qemu:///system {{(pid=75239) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f2d962d7070> {{(pid=75239) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 13 20:28:21 user nova-compute[75239]: libvirt:  error : internal error: could not initialize domain event timer
Nov 13 20:28:21 user nova-compute[75239]: WARNING nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 13 20:28:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f2d962d7070> {{(pid=75239) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Starting native event thread {{(pid=75239) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Starting green dispatch thread {{(pid=75239) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 13 20:28:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Starting connection event dispatch thread {{(pid=75239) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 13 20:28:21 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Connection event '1' reason 'None'
Nov 13 20:28:21 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 20:28:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.mount [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Initialising _HostMountState generation 0 {{(pid=75239) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 13 20:28:29 user nova-compute[75239]: INFO nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt host capabilities <capabilities>
Nov 13 20:28:29 user nova-compute[75239]:   <host>
Nov 13 20:28:29 user nova-compute[75239]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 13 20:28:29 user nova-compute[75239]:     <cpu>
Nov 13 20:28:29 user nova-compute[75239]:       <arch>x86_64</arch>
Nov 13 20:28:29 user nova-compute[75239]:       <model>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <vendor>Intel</vendor>
Nov 13 20:28:29 user nova-compute[75239]:       <microcode version='1070'/>
Nov 13 20:28:29 user nova-compute[75239]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 13 20:28:29 user nova-compute[75239]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='ss'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='vmx'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='pcid'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='osxsave'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='hypervisor'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='arat'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='tsc_adjust'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='md-clear'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='arch-capabilities'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='invtsc'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='rsba'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature name='skip-l1dfl-vmentry'/>
Nov 13 20:28:29 user nova-compute[75239]:       <pages unit='KiB' size='4'/>
Nov 13 20:28:29 user nova-compute[75239]:       <pages unit='KiB' size='2048'/>
Nov 13 20:28:29 user nova-compute[75239]:     </cpu>
Nov 13 20:28:29 user nova-compute[75239]:     <power_management>
Nov 13 20:28:29 user nova-compute[75239]:       <suspend_mem/>
Nov 13 20:28:29 user nova-compute[75239]:       <suspend_disk/>
Nov 13 20:28:29 user nova-compute[75239]:       <suspend_hybrid/>
Nov 13 20:28:29 user nova-compute[75239]:     </power_management>
Nov 13 20:28:29 user nova-compute[75239]:     <iommu support='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     <migration_features>
Nov 13 20:28:29 user nova-compute[75239]:       <live/>
Nov 13 20:28:29 user nova-compute[75239]:       <uri_transports>
Nov 13 20:28:29 user nova-compute[75239]:         <uri_transport>tcp</uri_transport>
Nov 13 20:28:29 user nova-compute[75239]:         <uri_transport>rdma</uri_transport>
Nov 13 20:28:29 user nova-compute[75239]:       </uri_transports>
Nov 13 20:28:29 user nova-compute[75239]:     </migration_features>
Nov 13 20:28:29 user nova-compute[75239]:     <topology>
Nov 13 20:28:29 user nova-compute[75239]:       <cells num='2'>
Nov 13 20:28:29 user nova-compute[75239]:         <cell id='0'>
Nov 13 20:28:29 user nova-compute[75239]:           <memory unit='KiB'>8140616</memory>
Nov 13 20:28:29 user nova-compute[75239]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 13 20:28:29 user nova-compute[75239]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 20:28:29 user nova-compute[75239]:           <distances>
Nov 13 20:28:29 user nova-compute[75239]:             <sibling id='0' value='10'/>
Nov 13 20:28:29 user nova-compute[75239]:             <sibling id='1' value='20'/>
Nov 13 20:28:29 user nova-compute[75239]:           </distances>
Nov 13 20:28:29 user nova-compute[75239]:           <cpus num='6'>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 13 20:28:29 user nova-compute[75239]:           </cpus>
Nov 13 20:28:29 user nova-compute[75239]:         </cell>
Nov 13 20:28:29 user nova-compute[75239]:         <cell id='1'>
Nov 13 20:28:29 user nova-compute[75239]:           <memory unit='KiB'>8255068</memory>
Nov 13 20:28:29 user nova-compute[75239]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 13 20:28:29 user nova-compute[75239]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 20:28:29 user nova-compute[75239]:           <distances>
Nov 13 20:28:29 user nova-compute[75239]:             <sibling id='0' value='20'/>
Nov 13 20:28:29 user nova-compute[75239]:             <sibling id='1' value='10'/>
Nov 13 20:28:29 user nova-compute[75239]:           </distances>
Nov 13 20:28:29 user nova-compute[75239]:           <cpus num='6'>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 13 20:28:29 user nova-compute[75239]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 13 20:28:29 user nova-compute[75239]:           </cpus>
Nov 13 20:28:29 user nova-compute[75239]:         </cell>
Nov 13 20:28:29 user nova-compute[75239]:       </cells>
Nov 13 20:28:29 user nova-compute[75239]:     </topology>
Nov 13 20:28:29 user nova-compute[75239]:     <cache>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 13 20:28:29 user nova-compute[75239]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 13 20:28:29 user nova-compute[75239]:     </cache>
Nov 13 20:28:29 user nova-compute[75239]:     <secmodel>
Nov 13 20:28:29 user nova-compute[75239]:       <model>apparmor</model>
Nov 13 20:28:29 user nova-compute[75239]:       <doi>0</doi>
Nov 13 20:28:29 user nova-compute[75239]:     </secmodel>
Nov 13 20:28:29 user nova-compute[75239]:     <secmodel>
Nov 13 20:28:29 user nova-compute[75239]:       <model>dac</model>
Nov 13 20:28:29 user nova-compute[75239]:       <doi>0</doi>
Nov 13 20:28:29 user nova-compute[75239]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 13 20:28:29 user nova-compute[75239]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 13 20:28:29 user nova-compute[75239]:     </secmodel>
Nov 13 20:28:29 user nova-compute[75239]:   </host>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='alpha'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>clipper</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='armv6l'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>spitz</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>nuri</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>kzm</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sx1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>z2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>tosa</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>n810</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>n800</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>terrier</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>midway</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>microbit</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>verdex</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>highbank</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>akita</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>connex</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>collie</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='armv7l'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>spitz</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>nuri</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>kzm</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sx1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>z2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>tosa</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>n810</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>n800</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>terrier</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>midway</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>microbit</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>verdex</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>highbank</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>akita</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>connex</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>collie</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='aarch64'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>spitz</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>nuri</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>kzm</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sx1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>z2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>tosa</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>n810</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>n800</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>terrier</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>midway</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>microbit</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>verdex</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>raspi3b</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>highbank</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>akita</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>connex</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>collie</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <acpi default='on' toggle='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='cris'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='i686'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>isapc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>microvm</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='kvm'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <pae/>
Nov 13 20:28:29 user nova-compute[75239]:       <nonpae/>
Nov 13 20:28:29 user nova-compute[75239]:       <acpi default='on' toggle='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:       <apic default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='m68k'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>an5206</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>q800</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>next-cube</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='microblaze'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='microblazeel'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='mips'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='16'>malta</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='mipsel'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='16'>malta</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='mips64'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='16'>malta</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>pica61</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>magnum</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='mips64el'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='16'>malta</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>pica61</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>magnum</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='16'>boston</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='ppc'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mac99</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>40p</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>taihu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='ppc64'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>taihu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>40p</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mac99</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='ppc64le'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>taihu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>40p</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>mac99</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='riscv32'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='8'>spike</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>opentitan</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='8'>virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='riscv64'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='8'>spike</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>shakti_c</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='8'>virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='s390x'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='sh4'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>shix</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>r2d</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='sh4eb'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>shix</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>r2d</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='sparc'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>SS-5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>SS-20</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>LX</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>SS-4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>SS-10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>Voyager</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='sparc64'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sun4u</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>niagara</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>sun4v</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='x86_64'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>64</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='1'>isapc</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>microvm</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='kvm'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <acpi default='on' toggle='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:       <apic default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='xtensa'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>sim</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>kc705</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>ml605</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>lx200</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>lx60</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]:   <guest>
Nov 13 20:28:29 user nova-compute[75239]:     <os_type>hvm</os_type>
Nov 13 20:28:29 user nova-compute[75239]:     <arch name='xtensaeb'>
Nov 13 20:28:29 user nova-compute[75239]:       <wordsize>32</wordsize>
Nov 13 20:28:29 user nova-compute[75239]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='4'>sim</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>kc705</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>ml605</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>virt</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>lx200</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>lx60</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 20:28:29 user nova-compute[75239]:       <domain type='qemu'/>
Nov 13 20:28:29 user nova-compute[75239]:     </arch>
Nov 13 20:28:29 user nova-compute[75239]:     <features>
Nov 13 20:28:29 user nova-compute[75239]:       <cpuselection/>
Nov 13 20:28:29 user nova-compute[75239]:       <deviceboot/>
Nov 13 20:28:29 user nova-compute[75239]:       <disksnapshot default='on' toggle='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     </features>
Nov 13 20:28:29 user nova-compute[75239]:   </guest>
Nov 13 20:28:29 user nova-compute[75239]: </capabilities>
Nov 13 20:28:29 user nova-compute[75239]: 
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 13 20:28:29 user nova-compute[75239]: <domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 20:28:29 user nova-compute[75239]:   <domain>kvm</domain>
Nov 13 20:28:29 user nova-compute[75239]:   <machine>pc-q35-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:   <arch>i686</arch>
Nov 13 20:28:29 user nova-compute[75239]:   <vcpu max='288'/>
Nov 13 20:28:29 user nova-compute[75239]:   <iothreads supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:   <os supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='firmware'/>
Nov 13 20:28:29 user nova-compute[75239]:     <loader supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>rom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pflash</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='readonly'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='secure'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </loader>
Nov 13 20:28:29 user nova-compute[75239]:   </os>
Nov 13 20:28:29 user nova-compute[75239]:   <cpu>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-passthrough' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='hostPassthroughMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='maximum' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='maximumMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-model' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <vendor>Intel</vendor>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ss'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='vmx'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pcid'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='hypervisor'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arat'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='umip'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='md-clear'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibpb'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibrs'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='erms'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='lm'/>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='custom' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>qemu64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>qemu32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>phenom</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>n270</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>kvm64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>coreduo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>core2duo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>athlon</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Westmere</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Snowridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Penryn</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G5</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G4</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G1</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Nehalem</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Rome</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Milan</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Dhyana</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cooperlake</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Conroe</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>486</model>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:   </cpu>
Nov 13 20:28:29 user nova-compute[75239]:   <memoryBacking supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='sourceType'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>file</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>anonymous</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>memfd</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:   </memoryBacking>
Nov 13 20:28:29 user nova-compute[75239]:   <devices>
Nov 13 20:28:29 user nova-compute[75239]:     <disk supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='diskDevice'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>disk</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cdrom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>floppy</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>lun</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='bus'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>fdc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sata</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </disk>
Nov 13 20:28:29 user nova-compute[75239]:     <graphics supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sdl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vnc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>spice</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egl-headless</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </graphics>
Nov 13 20:28:29 user nova-compute[75239]:     <video supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='modelType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cirrus</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vmvga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>qxl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>none</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>bochs</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ramfb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </video>
Nov 13 20:28:29 user nova-compute[75239]:     <hostdev supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='mode'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>subsystem</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='startupPolicy'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>default</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>mandatory</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>requisite</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>optional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='subsysType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pci</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='capsType'/>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='pciBackend'/>
Nov 13 20:28:29 user nova-compute[75239]:     </hostdev>
Nov 13 20:28:29 user nova-compute[75239]:     <rng supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>random</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egd</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>builtin</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </rng>
Nov 13 20:28:29 user nova-compute[75239]:     <filesystem supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='driverType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>path</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>handle</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtiofs</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </filesystem>
Nov 13 20:28:29 user nova-compute[75239]:     <tpm supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-tis</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-crb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>passthrough</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>emulator</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </tpm>
Nov 13 20:28:29 user nova-compute[75239]:   </devices>
Nov 13 20:28:29 user nova-compute[75239]:   <features>
Nov 13 20:28:29 user nova-compute[75239]:     <gic supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     <vmcoreinfo supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <genid supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backingStoreInput supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backup supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <sev supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:   </features>
Nov 13 20:28:29 user nova-compute[75239]: </domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:  {{(pid=75239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 13 20:28:29 user nova-compute[75239]: <domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 20:28:29 user nova-compute[75239]:   <domain>kvm</domain>
Nov 13 20:28:29 user nova-compute[75239]:   <machine>pc-i440fx-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:   <arch>i686</arch>
Nov 13 20:28:29 user nova-compute[75239]:   <vcpu max='255'/>
Nov 13 20:28:29 user nova-compute[75239]:   <iothreads supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:   <os supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='firmware'/>
Nov 13 20:28:29 user nova-compute[75239]:     <loader supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>rom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pflash</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='readonly'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='secure'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </loader>
Nov 13 20:28:29 user nova-compute[75239]:   </os>
Nov 13 20:28:29 user nova-compute[75239]:   <cpu>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-passthrough' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='hostPassthroughMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='maximum' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='maximumMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-model' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <vendor>Intel</vendor>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ss'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='vmx'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pcid'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='hypervisor'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arat'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='umip'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='md-clear'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibpb'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibrs'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='erms'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='lm'/>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='custom' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>qemu64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>qemu32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>phenom</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>n270</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>kvm64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>coreduo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>core2duo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>athlon</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Westmere</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Snowridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Penryn</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G5</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G4</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G1</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Nehalem</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Rome</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Milan</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Dhyana</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cooperlake</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Conroe</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>486</model>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:   </cpu>
Nov 13 20:28:29 user nova-compute[75239]:   <memoryBacking supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='sourceType'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>file</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>anonymous</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>memfd</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:   </memoryBacking>
Nov 13 20:28:29 user nova-compute[75239]:   <devices>
Nov 13 20:28:29 user nova-compute[75239]:     <disk supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='diskDevice'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>disk</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cdrom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>floppy</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>lun</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='bus'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ide</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>fdc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sata</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </disk>
Nov 13 20:28:29 user nova-compute[75239]:     <graphics supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sdl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vnc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>spice</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egl-headless</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </graphics>
Nov 13 20:28:29 user nova-compute[75239]:     <video supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='modelType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cirrus</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vmvga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>qxl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>none</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>bochs</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ramfb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </video>
Nov 13 20:28:29 user nova-compute[75239]:     <hostdev supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='mode'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>subsystem</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='startupPolicy'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>default</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>mandatory</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>requisite</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>optional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='subsysType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pci</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='capsType'/>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='pciBackend'/>
Nov 13 20:28:29 user nova-compute[75239]:     </hostdev>
Nov 13 20:28:29 user nova-compute[75239]:     <rng supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>random</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egd</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>builtin</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </rng>
Nov 13 20:28:29 user nova-compute[75239]:     <filesystem supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='driverType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>path</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>handle</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtiofs</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </filesystem>
Nov 13 20:28:29 user nova-compute[75239]:     <tpm supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-tis</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-crb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>passthrough</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>emulator</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </tpm>
Nov 13 20:28:29 user nova-compute[75239]:   </devices>
Nov 13 20:28:29 user nova-compute[75239]:   <features>
Nov 13 20:28:29 user nova-compute[75239]:     <gic supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     <vmcoreinfo supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <genid supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backingStoreInput supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backup supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <sev supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:   </features>
Nov 13 20:28:29 user nova-compute[75239]: </domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:  {{(pid=75239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 13 20:28:29 user nova-compute[75239]: <domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 20:28:29 user nova-compute[75239]:   <domain>kvm</domain>
Nov 13 20:28:29 user nova-compute[75239]:   <machine>pc-i440fx-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:   <arch>i686</arch>
Nov 13 20:28:29 user nova-compute[75239]:   <vcpu max='255'/>
Nov 13 20:28:29 user nova-compute[75239]:   <iothreads supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:   <os supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='firmware'/>
Nov 13 20:28:29 user nova-compute[75239]:     <loader supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>rom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pflash</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='readonly'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='secure'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </loader>
Nov 13 20:28:29 user nova-compute[75239]:   </os>
Nov 13 20:28:29 user nova-compute[75239]:   <cpu>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-passthrough' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='hostPassthroughMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='maximum' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='maximumMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-model' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <vendor>Intel</vendor>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ss'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='vmx'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pcid'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='hypervisor'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arat'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='umip'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='md-clear'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibpb'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibrs'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='erms'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='lm'/>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='custom' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>qemu64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>qemu32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>phenom</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>n270</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>kvm64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>coreduo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>core2duo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>athlon</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Westmere</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Snowridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Penryn</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G5</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G4</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G1</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Nehalem</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Rome</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Milan</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Dhyana</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cooperlake</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Conroe</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>486</model>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:   </cpu>
Nov 13 20:28:29 user nova-compute[75239]:   <memoryBacking supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='sourceType'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>file</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>anonymous</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>memfd</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:   </memoryBacking>
Nov 13 20:28:29 user nova-compute[75239]:   <devices>
Nov 13 20:28:29 user nova-compute[75239]:     <disk supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='diskDevice'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>disk</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cdrom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>floppy</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>lun</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='bus'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ide</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>fdc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sata</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </disk>
Nov 13 20:28:29 user nova-compute[75239]:     <graphics supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sdl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vnc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>spice</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egl-headless</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </graphics>
Nov 13 20:28:29 user nova-compute[75239]:     <video supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='modelType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cirrus</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vmvga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>qxl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>none</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>bochs</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ramfb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </video>
Nov 13 20:28:29 user nova-compute[75239]:     <hostdev supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='mode'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>subsystem</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='startupPolicy'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>default</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>mandatory</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>requisite</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>optional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='subsysType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pci</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='capsType'/>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='pciBackend'/>
Nov 13 20:28:29 user nova-compute[75239]:     </hostdev>
Nov 13 20:28:29 user nova-compute[75239]:     <rng supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>random</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egd</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>builtin</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </rng>
Nov 13 20:28:29 user nova-compute[75239]:     <filesystem supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='driverType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>path</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>handle</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtiofs</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </filesystem>
Nov 13 20:28:29 user nova-compute[75239]:     <tpm supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-tis</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-crb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>passthrough</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>emulator</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </tpm>
Nov 13 20:28:29 user nova-compute[75239]:   </devices>
Nov 13 20:28:29 user nova-compute[75239]:   <features>
Nov 13 20:28:29 user nova-compute[75239]:     <gic supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     <vmcoreinfo supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <genid supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backingStoreInput supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backup supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <sev supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:   </features>
Nov 13 20:28:29 user nova-compute[75239]: </domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:  {{(pid=75239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 13 20:28:29 user nova-compute[75239]: <domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 20:28:29 user nova-compute[75239]:   <domain>kvm</domain>
Nov 13 20:28:29 user nova-compute[75239]:   <machine>pc-q35-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:   <arch>i686</arch>
Nov 13 20:28:29 user nova-compute[75239]:   <vcpu max='288'/>
Nov 13 20:28:29 user nova-compute[75239]:   <iothreads supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:   <os supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='firmware'/>
Nov 13 20:28:29 user nova-compute[75239]:     <loader supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>rom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pflash</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='readonly'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='secure'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </loader>
Nov 13 20:28:29 user nova-compute[75239]:   </os>
Nov 13 20:28:29 user nova-compute[75239]:   <cpu>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-passthrough' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='hostPassthroughMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='maximum' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='maximumMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-model' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <vendor>Intel</vendor>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ss'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='vmx'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pcid'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='hypervisor'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arat'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='umip'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='md-clear'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibpb'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibrs'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='erms'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='lm'/>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='custom' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>qemu64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>qemu32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>phenom</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>n270</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>kvm64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>coreduo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>core2duo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>athlon</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Westmere</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Snowridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Penryn</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G5</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G4</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G1</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Nehalem</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Rome</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Milan</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Dhyana</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cooperlake</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Conroe</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>486</model>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:   </cpu>
Nov 13 20:28:29 user nova-compute[75239]:   <memoryBacking supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='sourceType'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>file</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>anonymous</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>memfd</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:   </memoryBacking>
Nov 13 20:28:29 user nova-compute[75239]:   <devices>
Nov 13 20:28:29 user nova-compute[75239]:     <disk supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='diskDevice'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>disk</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cdrom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>floppy</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>lun</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='bus'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>fdc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sata</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </disk>
Nov 13 20:28:29 user nova-compute[75239]:     <graphics supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sdl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vnc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>spice</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egl-headless</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </graphics>
Nov 13 20:28:29 user nova-compute[75239]:     <video supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='modelType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cirrus</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vmvga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>qxl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>none</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>bochs</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ramfb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </video>
Nov 13 20:28:29 user nova-compute[75239]:     <hostdev supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='mode'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>subsystem</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='startupPolicy'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>default</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>mandatory</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>requisite</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>optional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='subsysType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pci</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='capsType'/>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='pciBackend'/>
Nov 13 20:28:29 user nova-compute[75239]:     </hostdev>
Nov 13 20:28:29 user nova-compute[75239]:     <rng supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>random</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egd</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>builtin</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </rng>
Nov 13 20:28:29 user nova-compute[75239]:     <filesystem supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='driverType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>path</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>handle</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtiofs</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </filesystem>
Nov 13 20:28:29 user nova-compute[75239]:     <tpm supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-tis</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-crb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>passthrough</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>emulator</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </tpm>
Nov 13 20:28:29 user nova-compute[75239]:   </devices>
Nov 13 20:28:29 user nova-compute[75239]:   <features>
Nov 13 20:28:29 user nova-compute[75239]:     <gic supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     <vmcoreinfo supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <genid supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backingStoreInput supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backup supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <sev supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:   </features>
Nov 13 20:28:29 user nova-compute[75239]: </domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:  {{(pid=75239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'pc', 'ubuntu-q35'} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 13 20:28:29 user nova-compute[75239]: <domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 20:28:29 user nova-compute[75239]:   <domain>kvm</domain>
Nov 13 20:28:29 user nova-compute[75239]:   <machine>pc-q35-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:   <arch>x86_64</arch>
Nov 13 20:28:29 user nova-compute[75239]:   <vcpu max='288'/>
Nov 13 20:28:29 user nova-compute[75239]:   <iothreads supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:   <os supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='firmware'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>efi</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:     <loader supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>rom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pflash</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='readonly'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='secure'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </loader>
Nov 13 20:28:29 user nova-compute[75239]:   </os>
Nov 13 20:28:29 user nova-compute[75239]:   <cpu>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-passthrough' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='hostPassthroughMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='maximum' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='maximumMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-model' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <vendor>Intel</vendor>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ss'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='vmx'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pcid'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='hypervisor'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arat'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='umip'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='md-clear'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='invtsc'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibpb'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibrs'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='rsba'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='erms'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='custom' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>qemu64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>qemu32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>phenom</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>n270</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>coreduo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>core2duo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>athlon</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Westmere</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Snowridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Penryn</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G5</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G4</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Opteron_G1</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Nehalem</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Rome</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Milan</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Dhyana</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cooperlake</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Conroe</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>486</model>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:   </cpu>
Nov 13 20:28:29 user nova-compute[75239]:   <memoryBacking supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='sourceType'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>file</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>anonymous</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>memfd</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:   </memoryBacking>
Nov 13 20:28:29 user nova-compute[75239]:   <devices>
Nov 13 20:28:29 user nova-compute[75239]:     <disk supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='diskDevice'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>disk</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cdrom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>floppy</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>lun</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='bus'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>fdc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sata</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </disk>
Nov 13 20:28:29 user nova-compute[75239]:     <graphics supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sdl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vnc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>spice</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egl-headless</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </graphics>
Nov 13 20:28:29 user nova-compute[75239]:     <video supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='modelType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cirrus</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vmvga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>qxl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>none</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>bochs</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ramfb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </video>
Nov 13 20:28:29 user nova-compute[75239]:     <hostdev supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='mode'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>subsystem</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='startupPolicy'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>default</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>mandatory</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>requisite</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>optional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='subsysType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pci</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='capsType'/>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='pciBackend'/>
Nov 13 20:28:29 user nova-compute[75239]:     </hostdev>
Nov 13 20:28:29 user nova-compute[75239]:     <rng supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>random</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egd</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>builtin</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </rng>
Nov 13 20:28:29 user nova-compute[75239]:     <filesystem supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='driverType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>path</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>handle</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtiofs</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </filesystem>
Nov 13 20:28:29 user nova-compute[75239]:     <tpm supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-tis</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-crb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>passthrough</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>emulator</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </tpm>
Nov 13 20:28:29 user nova-compute[75239]:   </devices>
Nov 13 20:28:29 user nova-compute[75239]:   <features>
Nov 13 20:28:29 user nova-compute[75239]:     <gic supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     <vmcoreinfo supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <genid supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backingStoreInput supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backup supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <sev supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:   </features>
Nov 13 20:28:29 user nova-compute[75239]: </domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:  {{(pid=75239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 13 20:28:29 user nova-compute[75239]: <domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 20:28:29 user nova-compute[75239]:   <domain>kvm</domain>
Nov 13 20:28:29 user nova-compute[75239]:   <machine>pc-i440fx-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:   <arch>x86_64</arch>
Nov 13 20:28:29 user nova-compute[75239]:   <vcpu max='255'/>
Nov 13 20:28:29 user nova-compute[75239]:   <iothreads supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:   <os supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='firmware'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>efi</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:     <loader supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>rom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pflash</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='readonly'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='secure'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </loader>
Nov 13 20:28:29 user nova-compute[75239]:   </os>
Nov 13 20:28:29 user nova-compute[75239]:   <cpu>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-passthrough' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='hostPassthroughMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='maximum' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='maximumMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-model' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <vendor>Intel</vendor>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ss'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='vmx'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pcid'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='hypervisor'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arat'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='umip'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='md-clear'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='invtsc'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibpb'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibrs'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='rsba'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='erms'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='custom' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>qemu64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>qemu32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>phenom</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>n270</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>coreduo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>core2duo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>athlon</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Westmere</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Snowridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Penryn</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G5</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G4</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Opteron_G1</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Nehalem</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Rome</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Milan</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Dhyana</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cooperlake</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Conroe</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>486</model>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:   </cpu>
Nov 13 20:28:29 user nova-compute[75239]:   <memoryBacking supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='sourceType'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>file</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>anonymous</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>memfd</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:   </memoryBacking>
Nov 13 20:28:29 user nova-compute[75239]:   <devices>
Nov 13 20:28:29 user nova-compute[75239]:     <disk supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='diskDevice'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>disk</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cdrom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>floppy</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>lun</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='bus'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ide</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>fdc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sata</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </disk>
Nov 13 20:28:29 user nova-compute[75239]:     <graphics supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sdl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vnc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>spice</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egl-headless</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </graphics>
Nov 13 20:28:29 user nova-compute[75239]:     <video supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='modelType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cirrus</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vmvga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>qxl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>none</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>bochs</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ramfb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </video>
Nov 13 20:28:29 user nova-compute[75239]:     <hostdev supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='mode'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>subsystem</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='startupPolicy'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>default</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>mandatory</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>requisite</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>optional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='subsysType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pci</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='capsType'/>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='pciBackend'/>
Nov 13 20:28:29 user nova-compute[75239]:     </hostdev>
Nov 13 20:28:29 user nova-compute[75239]:     <rng supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>random</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egd</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>builtin</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </rng>
Nov 13 20:28:29 user nova-compute[75239]:     <filesystem supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='driverType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>path</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>handle</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtiofs</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </filesystem>
Nov 13 20:28:29 user nova-compute[75239]:     <tpm supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-tis</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-crb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>passthrough</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>emulator</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </tpm>
Nov 13 20:28:29 user nova-compute[75239]:   </devices>
Nov 13 20:28:29 user nova-compute[75239]:   <features>
Nov 13 20:28:29 user nova-compute[75239]:     <gic supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     <vmcoreinfo supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <genid supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backingStoreInput supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backup supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <sev supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:   </features>
Nov 13 20:28:29 user nova-compute[75239]: </domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:  {{(pid=75239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 13 20:28:29 user nova-compute[75239]: <domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 20:28:29 user nova-compute[75239]:   <domain>kvm</domain>
Nov 13 20:28:29 user nova-compute[75239]:   <machine>pc-i440fx-6.2</machine>
Nov 13 20:28:29 user nova-compute[75239]:   <arch>x86_64</arch>
Nov 13 20:28:29 user nova-compute[75239]:   <vcpu max='255'/>
Nov 13 20:28:29 user nova-compute[75239]:   <iothreads supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:   <os supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='firmware'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>efi</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:     <loader supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>rom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pflash</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='readonly'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='secure'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </loader>
Nov 13 20:28:29 user nova-compute[75239]:   </os>
Nov 13 20:28:29 user nova-compute[75239]:   <cpu>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-passthrough' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='hostPassthroughMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='maximum' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='maximumMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-model' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <vendor>Intel</vendor>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ss'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='vmx'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pcid'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='hypervisor'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arat'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='umip'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='md-clear'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='invtsc'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibpb'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibrs'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='rsba'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='erms'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='custom' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>qemu64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>qemu32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>phenom</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>n270</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>coreduo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>core2duo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>athlon</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Westmere</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Snowridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Penryn</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G5</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G4</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Opteron_G1</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Nehalem</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Rome</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Milan</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Dhyana</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cooperlake</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Conroe</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>486</model>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:   </cpu>
Nov 13 20:28:29 user nova-compute[75239]:   <memoryBacking supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='sourceType'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>file</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>anonymous</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>memfd</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:   </memoryBacking>
Nov 13 20:28:29 user nova-compute[75239]:   <devices>
Nov 13 20:28:29 user nova-compute[75239]:     <disk supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='diskDevice'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>disk</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cdrom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>floppy</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>lun</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='bus'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ide</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>fdc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sata</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </disk>
Nov 13 20:28:29 user nova-compute[75239]:     <graphics supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sdl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vnc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>spice</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egl-headless</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </graphics>
Nov 13 20:28:29 user nova-compute[75239]:     <video supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='modelType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cirrus</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vmvga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>qxl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>none</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>bochs</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ramfb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </video>
Nov 13 20:28:29 user nova-compute[75239]:     <hostdev supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='mode'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>subsystem</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='startupPolicy'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>default</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>mandatory</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>requisite</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>optional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='subsysType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pci</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='capsType'/>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='pciBackend'/>
Nov 13 20:28:29 user nova-compute[75239]:     </hostdev>
Nov 13 20:28:29 user nova-compute[75239]:     <rng supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>random</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egd</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>builtin</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </rng>
Nov 13 20:28:29 user nova-compute[75239]:     <filesystem supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='driverType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>path</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>handle</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtiofs</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </filesystem>
Nov 13 20:28:29 user nova-compute[75239]:     <tpm supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-tis</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-crb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>passthrough</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>emulator</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </tpm>
Nov 13 20:28:29 user nova-compute[75239]:   </devices>
Nov 13 20:28:29 user nova-compute[75239]:   <features>
Nov 13 20:28:29 user nova-compute[75239]:     <gic supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     <vmcoreinfo supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <genid supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backingStoreInput supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backup supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <sev supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:   </features>
Nov 13 20:28:29 user nova-compute[75239]: </domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:  {{(pid=75239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 13 20:28:29 user nova-compute[75239]: <domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 20:28:29 user nova-compute[75239]:   <domain>kvm</domain>
Nov 13 20:28:29 user nova-compute[75239]:   <machine>pc-q35-jammy</machine>
Nov 13 20:28:29 user nova-compute[75239]:   <arch>x86_64</arch>
Nov 13 20:28:29 user nova-compute[75239]:   <vcpu max='288'/>
Nov 13 20:28:29 user nova-compute[75239]:   <iothreads supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:   <os supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='firmware'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>efi</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:     <loader supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>rom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pflash</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='readonly'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='secure'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>yes</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>no</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </loader>
Nov 13 20:28:29 user nova-compute[75239]:   </os>
Nov 13 20:28:29 user nova-compute[75239]:   <cpu>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-passthrough' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='hostPassthroughMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='maximum' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='maximumMigratable'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>on</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>off</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='host-model' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <vendor>Intel</vendor>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ss'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='vmx'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pcid'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='hypervisor'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arat'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='umip'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='md-clear'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='invtsc'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibpb'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='ibrs'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-stibp'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='rsba'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='erms'/>
Nov 13 20:28:29 user nova-compute[75239]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:     <mode name='custom' supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>qemu64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>qemu32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>phenom</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>pentium</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>n270</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm64</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>kvm32</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>coreduo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>core2duo</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>athlon</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Westmere</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Snowridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Skylake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>SandyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Penryn</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G5</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G4</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G3</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Opteron_G2</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Opteron_G1</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Nehalem</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>IvyBridge</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Icelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Haswell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Rome</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-Milan</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>EPYC</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Dhyana</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cooperlake</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>Conroe</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='no'>Broadwell</model>
Nov 13 20:28:29 user nova-compute[75239]:       <model usable='yes'>486</model>
Nov 13 20:28:29 user nova-compute[75239]:     </mode>
Nov 13 20:28:29 user nova-compute[75239]:   </cpu>
Nov 13 20:28:29 user nova-compute[75239]:   <memoryBacking supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:     <enum name='sourceType'>
Nov 13 20:28:29 user nova-compute[75239]:       <value>file</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>anonymous</value>
Nov 13 20:28:29 user nova-compute[75239]:       <value>memfd</value>
Nov 13 20:28:29 user nova-compute[75239]:     </enum>
Nov 13 20:28:29 user nova-compute[75239]:   </memoryBacking>
Nov 13 20:28:29 user nova-compute[75239]:   <devices>
Nov 13 20:28:29 user nova-compute[75239]:     <disk supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='diskDevice'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>disk</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cdrom</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>floppy</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>lun</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='bus'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>fdc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sata</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </disk>
Nov 13 20:28:29 user nova-compute[75239]:     <graphics supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='type'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>sdl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vnc</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>spice</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egl-headless</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </graphics>
Nov 13 20:28:29 user nova-compute[75239]:     <video supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='modelType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>cirrus</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>vmvga</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>qxl</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>none</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>bochs</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>ramfb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </video>
Nov 13 20:28:29 user nova-compute[75239]:     <hostdev supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='mode'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>subsystem</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='startupPolicy'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>default</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>mandatory</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>requisite</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>optional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='subsysType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>usb</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>pci</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>scsi</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='capsType'/>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='pciBackend'/>
Nov 13 20:28:29 user nova-compute[75239]:     </hostdev>
Nov 13 20:28:29 user nova-compute[75239]:     <rng supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtio-non-transitional</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>random</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>egd</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>builtin</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </rng>
Nov 13 20:28:29 user nova-compute[75239]:     <filesystem supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='driverType'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>path</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>handle</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>virtiofs</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </filesystem>
Nov 13 20:28:29 user nova-compute[75239]:     <tpm supported='yes'>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='model'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-tis</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>tpm-crb</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:       <enum name='backendModel'>
Nov 13 20:28:29 user nova-compute[75239]:         <value>passthrough</value>
Nov 13 20:28:29 user nova-compute[75239]:         <value>emulator</value>
Nov 13 20:28:29 user nova-compute[75239]:       </enum>
Nov 13 20:28:29 user nova-compute[75239]:     </tpm>
Nov 13 20:28:29 user nova-compute[75239]:   </devices>
Nov 13 20:28:29 user nova-compute[75239]:   <features>
Nov 13 20:28:29 user nova-compute[75239]:     <gic supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:     <vmcoreinfo supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <genid supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backingStoreInput supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <backup supported='yes'/>
Nov 13 20:28:29 user nova-compute[75239]:     <sev supported='no'/>
Nov 13 20:28:29 user nova-compute[75239]:   </features>
Nov 13 20:28:29 user nova-compute[75239]: </domainCapabilities>
Nov 13 20:28:29 user nova-compute[75239]:  {{(pid=75239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Checking secure boot support for host arch (x86_64) {{(pid=75239) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 20:28:29 user nova-compute[75239]: INFO nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Secure Boot support detected
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] cpu compare xml: <cpu match="exact">
Nov 13 20:28:29 user nova-compute[75239]:   <model>Nehalem</model>
Nov 13 20:28:29 user nova-compute[75239]: </cpu>
Nov 13 20:28:29 user nova-compute[75239]:  {{(pid=75239) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 13 20:28:29 user nova-compute[75239]: INFO nova.virt.node [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Generated node identity 6c1abe79-622f-4b7b-89fd-35e20ccec6d4
Nov 13 20:28:29 user nova-compute[75239]: INFO nova.virt.node [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Wrote node identity 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 to /opt/stack/data/nova/compute_id
Nov 13 20:28:29 user nova-compute[75239]: WARNING nova.compute.manager [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Compute nodes ['6c1abe79-622f-4b7b-89fd-35e20ccec6d4'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 13 20:28:29 user nova-compute[75239]: INFO nova.compute.manager [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 13 20:28:29 user nova-compute[75239]: WARNING nova.compute.manager [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 20:28:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:28:29 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:28:29 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Hypervisor/Node resource view: name=user free_ram=10992MB free_disk=26.03783416748047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:28:29 user nova-compute[75239]: WARNING nova.compute.resource_tracker [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] No compute node record for user:6c1abe79-622f-4b7b-89fd-35e20ccec6d4: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 could not be found.
Nov 13 20:28:29 user nova-compute[75239]: INFO nova.compute.resource_tracker [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Compute node record created for user:user with uuid: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:28:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:28:30 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] [req-209ec639-207d-4bae-8c86-364afb728090] Created resource provider record via placement API for resource provider with UUID 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 and name user.
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75239) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 13 20:28:30 user nova-compute[75239]: INFO nova.virt.libvirt.host [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] kernel doesn't support AMD SEV
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Libvirt baseline CPU <cpu>
Nov 13 20:28:30 user nova-compute[75239]:   <arch>x86_64</arch>
Nov 13 20:28:30 user nova-compute[75239]:   <model>Nehalem</model>
Nov 13 20:28:30 user nova-compute[75239]:   <vendor>Intel</vendor>
Nov 13 20:28:30 user nova-compute[75239]:   <topology sockets="6" cores="1" threads="1"/>
Nov 13 20:28:30 user nova-compute[75239]: </cpu>
Nov 13 20:28:30 user nova-compute[75239]:  {{(pid=75239) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Updated inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Updating resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 generation from 0 to 1 during operation: update_inventory {{(pid=75239) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Updating resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 generation from 1 to 2 during operation: update_traits {{(pid=75239) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.844s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.service [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Creating RPC server for service compute {{(pid=75239) start /opt/stack/nova/nova/service.py:182}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.service [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] Join ServiceGroup membership for this service compute {{(pid=75239) start /opt/stack/nova/nova/service.py:199}}
Nov 13 20:28:30 user nova-compute[75239]: DEBUG nova.servicegroup.drivers.db [None req-fa4e2ff8-3903-48b6-9355-d9a6be42e84c None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75239) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 13 20:28:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:28:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:29:21 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:29:21 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=10443MB free_disk=25.941600799560547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:29:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:30:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:30:22 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:30:22 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:30:22 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=10389MB free_disk=26.00661849975586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:30:22 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:30:23 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:30:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:30:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:30:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 20:30:23 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:31:21 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:31:21 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:31:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=10382MB free_disk=25.76081085205078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:31:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:31:22 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:31:23 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:31:23 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:31:23 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:31:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:31:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:31:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:31:25 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:31:25 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:31:25 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:31:25 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 20:31:25 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:32:22 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:22 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:22 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9666MB free_disk=25.787334442138672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:32:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.121s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:23 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:23 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:32:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:25 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:25 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:26 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:27 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:32:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:32:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:32:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 20:32:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "5771f282-957f-4c19-8e50-0d85248a8605" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:28 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:32:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:32:28 user nova-compute[75239]: INFO nova.compute.claims [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Claim successful on node user
Nov 13 20:32:29 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:32:29 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:32:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:32:29 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Creating image(s)
Nov 13 20:32:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "/opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "/opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "/opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:30 user nova-compute[75239]: DEBUG nova.policy [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a71d5dd4e524fb6ad98d7c1de9c383b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43a004ca2b494127b60d661613aecdc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:32:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79.part --force-share --output=json" returned: 0 in 0.202s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:30 user nova-compute[75239]: DEBUG nova.virt.images [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] 800ade11-c0e2-452c-9cf5-70051593ac8f was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:32:30 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:32:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79.part /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79.part /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79.converted" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79.converted --force-share --output=json" returned: 0 in 0.328s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.679s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:31 user nova-compute[75239]: INFO oslo.privsep.daemon [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpuzrm417n/privsep.sock']
Nov 13 20:32:31 user sudo[84479]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpuzrm417n/privsep.sock
Nov 13 20:32:31 user sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 20:32:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:32:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:32 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:32:32 user nova-compute[75239]: INFO nova.compute.claims [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Claim successful on node user
Nov 13 20:32:32 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:32:32 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:32:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.247s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:32:32 user sudo[84479]: pam_unix(sudo:session): session closed for user root
Nov 13 20:32:32 user nova-compute[75239]: INFO oslo.privsep.daemon [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Spawned new privsep daemon via rootwrap
Nov 13 20:32:32 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 20:32:32 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 20:32:32 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 13 20:32:32 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84489
Nov 13 20:32:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:32:32 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:32:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:32:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.164s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:32:33 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Creating image(s)
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "/opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "/opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "/opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Successfully created port: 0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.203s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk 1073741824" returned: 0 in 0.039s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG nova.policy [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1fa0bf5a26e4844a22d48ce70d8dc0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a86eedbea84af3a57a6a4b266c06d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk 1073741824" returned: 0 in 0.038s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Cannot resize image /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Ensure instance console log exists: /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:32:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Cannot resize image /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Ensure instance console log exists: /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:32:34 user nova-compute[75239]: INFO nova.compute.claims [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Claim successful on node user
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.182s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:32:34 user nova-compute[75239]: INFO nova.compute.claims [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Claim successful on node user
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:32:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:32:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.policy [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d8ae2d158f94548bc3d9873317935cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14ce616b1ad4ee7934e34bad1fdf6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:32:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Creating image(s)
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "/opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "/opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "/opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.241s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:32:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Successfully updated port: 0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "refresh_cache-5771f282-957f-4c19-8e50-0d85248a8605" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquired lock "refresh_cache-5771f282-957f-4c19-8e50-0d85248a8605" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk 1073741824" returned: 0 in 0.045s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:32:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Creating image(s)
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "/opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "/opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "/opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Successfully created port: af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.policy [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2669d647fe6f4034bc70703546345eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465510aec2849dfb0917120a772f066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.196s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-bc03215b-d67e-4b85-afab-180b274d9553 req-53b7764c-0ee1-4be0-ad1c-c9b5cd6ba1db service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received event network-changed-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-bc03215b-d67e-4b85-afab-180b274d9553 req-53b7764c-0ee1-4be0-ad1c-c9b5cd6ba1db service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Refreshing instance network info cache due to event network-changed-0bb0198a-395e-45fb-88cd-53909c6b5521. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bc03215b-d67e-4b85-afab-180b274d9553 req-53b7764c-0ee1-4be0-ad1c-c9b5cd6ba1db service nova] Acquiring lock "refresh_cache-5771f282-957f-4c19-8e50-0d85248a8605" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.195s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Cannot resize image /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Ensure instance console log exists: /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk 1073741824" returned: 0 in 0.047s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Updating instance_info_cache with network_info: [{"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Releasing lock "refresh_cache-5771f282-957f-4c19-8e50-0d85248a8605" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Instance network_info: |[{"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bc03215b-d67e-4b85-afab-180b274d9553 req-53b7764c-0ee1-4be0-ad1c-c9b5cd6ba1db service nova] Acquired lock "refresh_cache-5771f282-957f-4c19-8e50-0d85248a8605" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.network.neutron [req-bc03215b-d67e-4b85-afab-180b274d9553 req-53b7764c-0ee1-4be0-ad1c-c9b5cd6ba1db service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Refreshing network info cache for port 0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Start _get_guest_xml network_info=[{"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:32:36 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:36 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-472268224',display_name='tempest-DeleteServersTestJSON-server-472268224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-472268224',id=1,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43a004ca2b494127b60d661613aecdc1',ramdisk_id='',reservation_id='r-g50hbf0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-636220024',owner_user_name='tempest-DeleteServersTestJSON-636220024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:29Z,user_data=None,user_id='5a71d5dd4e524fb6ad98d7c1de9c383b',uuid=5771f282-957f-4c19-8e50-0d85248a8605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Converting VIF {"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:d4:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bb0198a-395e-45fb-88cd-53909c6b5521,network=Network(fd590099-f604-4b86-8a7e-cba82ec0feb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb0198a-39') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.objects.instance [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lazy-loading 'pci_devices' on Instance uuid 5771f282-957f-4c19-8e50-0d85248a8605 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.253s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:32:36 user nova-compute[75239]:   <uuid>5771f282-957f-4c19-8e50-0d85248a8605</uuid>
Nov 13 20:32:36 user nova-compute[75239]:   <name>instance-00000001</name>
Nov 13 20:32:36 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:32:36 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:32:36 user nova-compute[75239]:   <metadata>
Nov 13 20:32:36 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:32:36 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:32:36 user nova-compute[75239]:       <nova:name>tempest-DeleteServersTestJSON-server-472268224</nova:name>
Nov 13 20:32:36 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:32:36</nova:creationTime>
Nov 13 20:32:36 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:32:36 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:32:36 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:32:36 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:32:36 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:32:36 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:32:36 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:32:36 user nova-compute[75239]:       <nova:owner>
Nov 13 20:32:36 user nova-compute[75239]:         <nova:user uuid="5a71d5dd4e524fb6ad98d7c1de9c383b">tempest-DeleteServersTestJSON-636220024-project-member</nova:user>
Nov 13 20:32:36 user nova-compute[75239]:         <nova:project uuid="43a004ca2b494127b60d661613aecdc1">tempest-DeleteServersTestJSON-636220024</nova:project>
Nov 13 20:32:36 user nova-compute[75239]:       </nova:owner>
Nov 13 20:32:36 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:32:36 user nova-compute[75239]:       <nova:ports>
Nov 13 20:32:36 user nova-compute[75239]:         <nova:port uuid="0bb0198a-395e-45fb-88cd-53909c6b5521">
Nov 13 20:32:36 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 20:32:36 user nova-compute[75239]:         </nova:port>
Nov 13 20:32:36 user nova-compute[75239]:       </nova:ports>
Nov 13 20:32:36 user nova-compute[75239]:     </nova:instance>
Nov 13 20:32:36 user nova-compute[75239]:   </metadata>
Nov 13 20:32:36 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:32:36 user nova-compute[75239]:     <system>
Nov 13 20:32:36 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:32:36 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:32:36 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:32:36 user nova-compute[75239]:       <entry name="serial">5771f282-957f-4c19-8e50-0d85248a8605</entry>
Nov 13 20:32:36 user nova-compute[75239]:       <entry name="uuid">5771f282-957f-4c19-8e50-0d85248a8605</entry>
Nov 13 20:32:36 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:32:36 user nova-compute[75239]:     </system>
Nov 13 20:32:36 user nova-compute[75239]:   </sysinfo>
Nov 13 20:32:36 user nova-compute[75239]:   <os>
Nov 13 20:32:36 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:32:36 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:32:36 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:32:36 user nova-compute[75239]:   </os>
Nov 13 20:32:36 user nova-compute[75239]:   <features>
Nov 13 20:32:36 user nova-compute[75239]:     <acpi/>
Nov 13 20:32:36 user nova-compute[75239]:     <apic/>
Nov 13 20:32:36 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:32:36 user nova-compute[75239]:   </features>
Nov 13 20:32:36 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:32:36 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:32:36 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:32:36 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:32:36 user nova-compute[75239]:   </clock>
Nov 13 20:32:36 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:32:36 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:32:36 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:32:36 user nova-compute[75239]:   </cpu>
Nov 13 20:32:36 user nova-compute[75239]:   <devices>
Nov 13 20:32:36 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:32:36 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:32:36 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk"/>
Nov 13 20:32:36 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:32:36 user nova-compute[75239]:     </disk>
Nov 13 20:32:36 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:32:36 user nova-compute[75239]:       <mac address="fa:16:3e:79:d4:a5"/>
Nov 13 20:32:36 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:36 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:32:36 user nova-compute[75239]:       <target dev="tap0bb0198a-39"/>
Nov 13 20:32:36 user nova-compute[75239]:     </interface>
Nov 13 20:32:36 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:32:36 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/console.log" append="off"/>
Nov 13 20:32:36 user nova-compute[75239]:     </serial>
Nov 13 20:32:36 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:32:36 user nova-compute[75239]:     <video>
Nov 13 20:32:36 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:36 user nova-compute[75239]:     </video>
Nov 13 20:32:36 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:32:36 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:32:36 user nova-compute[75239]:     </rng>
Nov 13 20:32:36 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:32:36 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:32:36 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:32:36 user nova-compute[75239]:     </memballoon>
Nov 13 20:32:36 user nova-compute[75239]:   </devices>
Nov 13 20:32:36 user nova-compute[75239]: </domain>
Nov 13 20:32:36 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-472268224',display_name='tempest-DeleteServersTestJSON-server-472268224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-472268224',id=1,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43a004ca2b494127b60d661613aecdc1',ramdisk_id='',reservation_id='r-g50hbf0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-636220024',owner_user_name='tempest-DeleteServersTestJSON-636220024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:29Z,user_data=None,user_id='5a71d5dd4e524fb6ad98d7c1de9c383b',uuid=5771f282-957f-4c19-8e50-0d85248a8605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Converting VIF {"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:d4:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bb0198a-395e-45fb-88cd-53909c6b5521,network=Network(fd590099-f604-4b86-8a7e-cba82ec0feb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb0198a-39') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG os_vif [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:d4:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bb0198a-395e-45fb-88cd-53909c6b5521,network=Network(fd590099-f604-4b86-8a7e-cba82ec0feb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb0198a-39') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Created schema index Interface.name {{(pid=75239) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Created schema index Port.name {{(pid=75239) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Created schema index Bridge.name {{(pid=75239) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [POLLOUT] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Cannot resize image /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Ensure instance console log exists: /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c317ce0f-07e7-5e58-95e2-f74a4615b0bb', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:36 user nova-compute[75239]: INFO oslo.privsep.daemon [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpqkvu9_54/privsep.sock']
Nov 13 20:32:36 user sudo[84563]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpqkvu9_54/privsep.sock
Nov 13 20:32:36 user sudo[84563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:32:37 user nova-compute[75239]: INFO nova.compute.claims [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Claim successful on node user
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:32:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.network.neutron [req-bc03215b-d67e-4b85-afab-180b274d9553 req-53b7764c-0ee1-4be0-ad1c-c9b5cd6ba1db service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Updated VIF entry in instance network info cache for port 0bb0198a-395e-45fb-88cd-53909c6b5521. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.network.neutron [req-bc03215b-d67e-4b85-afab-180b274d9553 req-53b7764c-0ee1-4be0-ad1c-c9b5cd6ba1db service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Updating instance_info_cache with network_info: [{"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:32:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Creating image(s)
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bc03215b-d67e-4b85-afab-180b274d9553 req-53b7764c-0ee1-4be0-ad1c-c9b5cd6ba1db service nova] Releasing lock "refresh_cache-5771f282-957f-4c19-8e50-0d85248a8605" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG nova.policy [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '66625adc0c8d4508987cc570c5ae3b32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce07a49816064edfbf14f89b5895e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:32:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:38 user sudo[84563]: pam_unix(sudo:session): session closed for user root
Nov 13 20:32:38 user nova-compute[75239]: INFO oslo.privsep.daemon [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Spawned new privsep daemon via rootwrap
Nov 13 20:32:38 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 20:32:38 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 20:32:38 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 13 20:32:38 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84566
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk 1073741824" returned: 0 in 0.039s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Successfully created port: 0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0bb0198a-39, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0bb0198a-39, col_values=(('qos', UUID('083c7811-5af9-4a31-b5a1-0875b975896c')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0bb0198a-39, col_values=(('external_ids', {'iface-id': '0bb0198a-395e-45fb-88cd-53909c6b5521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:d4:a5', 'vm-uuid': '5771f282-957f-4c19-8e50-0d85248a8605'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:38 user nova-compute[75239]: INFO os_vif [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:d4:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bb0198a-395e-45fb-88cd-53909c6b5521,network=Network(fd590099-f604-4b86-8a7e-cba82ec0feb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb0198a-39')
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Cannot resize image /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Ensure instance console log exists: /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] No VIF found with MAC fa:16:3e:79:d4:a5, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:32:38 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Successfully created port: 300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Successfully created port: 8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Successfully updated port: af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquired lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-f67a7538-a6cd-480f-b96d-433764ffbd5b req-b186c4e9-aad6-4385-853f-4dea354347e4 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-changed-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-f67a7538-a6cd-480f-b96d-433764ffbd5b req-b186c4e9-aad6-4385-853f-4dea354347e4 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Refreshing instance network info cache due to event network-changed-af2c8770-f7b4-4446-8061-7c377b8ad1f5. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f67a7538-a6cd-480f-b96d-433764ffbd5b req-b186c4e9-aad6-4385-853f-4dea354347e4 service nova] Acquiring lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Successfully updated port: 8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquired lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating instance_info_cache with network_info: [{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Releasing lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance network_info: |[{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f67a7538-a6cd-480f-b96d-433764ffbd5b req-b186c4e9-aad6-4385-853f-4dea354347e4 service nova] Acquired lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.neutron [req-f67a7538-a6cd-480f-b96d-433764ffbd5b req-b186c4e9-aad6-4385-853f-4dea354347e4 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Refreshing network info cache for port af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Start _get_guest_xml network_info=[{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:32:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1584967376',display_name='tempest-AttachVolumeTestJSON-server-1584967376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1584967376',id=2,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKLqFZyQUrPE9Rky07V7+GOb/b3wRFXW0Dqh5CX+FEDomGoakG24id5wbLzS4TXRnaOkbwA4OVXWvMEC23O9oNn05+UEn3Pmq3JjLiMnSUlNw/+Sk65Td7hW84pUseSw==',key_name='tempest-keypair-823327680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-9qfk4iec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=f59ce508-2487-4e71-8c09-ffd17dd0eafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.objects.instance [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'pci_devices' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:32:41 user nova-compute[75239]:   <uuid>f59ce508-2487-4e71-8c09-ffd17dd0eafc</uuid>
Nov 13 20:32:41 user nova-compute[75239]:   <name>instance-00000002</name>
Nov 13 20:32:41 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:32:41 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:32:41 user nova-compute[75239]:   <metadata>
Nov 13 20:32:41 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:32:41 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeTestJSON-server-1584967376</nova:name>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:32:41</nova:creationTime>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:32:41 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:32:41 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:owner>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:user uuid="a1fa0bf5a26e4844a22d48ce70d8dc0a">tempest-AttachVolumeTestJSON-2111443236-project-member</nova:user>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:project uuid="b0a86eedbea84af3a57a6a4b266c06d4">tempest-AttachVolumeTestJSON-2111443236</nova:project>
Nov 13 20:32:41 user nova-compute[75239]:       </nova:owner>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:ports>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:port uuid="af2c8770-f7b4-4446-8061-7c377b8ad1f5">
Nov 13 20:32:41 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:32:41 user nova-compute[75239]:         </nova:port>
Nov 13 20:32:41 user nova-compute[75239]:       </nova:ports>
Nov 13 20:32:41 user nova-compute[75239]:     </nova:instance>
Nov 13 20:32:41 user nova-compute[75239]:   </metadata>
Nov 13 20:32:41 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:32:41 user nova-compute[75239]:     <system>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="serial">f59ce508-2487-4e71-8c09-ffd17dd0eafc</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="uuid">f59ce508-2487-4e71-8c09-ffd17dd0eafc</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:32:41 user nova-compute[75239]:     </system>
Nov 13 20:32:41 user nova-compute[75239]:   </sysinfo>
Nov 13 20:32:41 user nova-compute[75239]:   <os>
Nov 13 20:32:41 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:32:41 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:32:41 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:32:41 user nova-compute[75239]:   </os>
Nov 13 20:32:41 user nova-compute[75239]:   <features>
Nov 13 20:32:41 user nova-compute[75239]:     <acpi/>
Nov 13 20:32:41 user nova-compute[75239]:     <apic/>
Nov 13 20:32:41 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:32:41 user nova-compute[75239]:   </features>
Nov 13 20:32:41 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:32:41 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:32:41 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:32:41 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:32:41 user nova-compute[75239]:   </clock>
Nov 13 20:32:41 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:32:41 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:32:41 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:32:41 user nova-compute[75239]:   </cpu>
Nov 13 20:32:41 user nova-compute[75239]:   <devices>
Nov 13 20:32:41 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:32:41 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:32:41 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk"/>
Nov 13 20:32:41 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:32:41 user nova-compute[75239]:     </disk>
Nov 13 20:32:41 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:32:41 user nova-compute[75239]:       <mac address="fa:16:3e:9f:11:19"/>
Nov 13 20:32:41 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:41 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:32:41 user nova-compute[75239]:       <target dev="tapaf2c8770-f7"/>
Nov 13 20:32:41 user nova-compute[75239]:     </interface>
Nov 13 20:32:41 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:32:41 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/console.log" append="off"/>
Nov 13 20:32:41 user nova-compute[75239]:     </serial>
Nov 13 20:32:41 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:32:41 user nova-compute[75239]:     <video>
Nov 13 20:32:41 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:41 user nova-compute[75239]:     </video>
Nov 13 20:32:41 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:32:41 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:32:41 user nova-compute[75239]:     </rng>
Nov 13 20:32:41 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:32:41 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:32:41 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:32:41 user nova-compute[75239]:     </memballoon>
Nov 13 20:32:41 user nova-compute[75239]:   </devices>
Nov 13 20:32:41 user nova-compute[75239]: </domain>
Nov 13 20:32:41 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1584967376',display_name='tempest-AttachVolumeTestJSON-server-1584967376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1584967376',id=2,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKLqFZyQUrPE9Rky07V7+GOb/b3wRFXW0Dqh5CX+FEDomGoakG24id5wbLzS4TXRnaOkbwA4OVXWvMEC23O9oNn05+UEn3Pmq3JjLiMnSUlNw/+Sk65Td7hW84pUseSw==',key_name='tempest-keypair-823327680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-9qfk4iec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=f59ce508-2487-4e71-8c09-ffd17dd0eafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG os_vif [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf7f58c3-2746-521a-93e7-2a26466a9f03', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf2c8770-f7, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf2c8770-f7, col_values=(('qos', UUID('1cc75552-80de-45bf-a5cb-7ee3aa2081c4')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf2c8770-f7, col_values=(('external_ids', {'iface-id': 'af2c8770-f7b4-4446-8061-7c377b8ad1f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:11:19', 'vm-uuid': 'f59ce508-2487-4e71-8c09-ffd17dd0eafc'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: INFO os_vif [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7')
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-287a604d-3dc5-4f54-95c7-be392746ce01 req-02dd3975-87af-4c17-82a7-12f5c1001cbd service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-changed-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-287a604d-3dc5-4f54-95c7-be392746ce01 req-02dd3975-87af-4c17-82a7-12f5c1001cbd service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Refreshing instance network info cache due to event network-changed-8e91bea0-dea9-49f6-ac95-f485a29d5cd2. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-287a604d-3dc5-4f54-95c7-be392746ce01 req-02dd3975-87af-4c17-82a7-12f5c1001cbd service nova] Acquiring lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No VIF found with MAC fa:16:3e:9f:11:19, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:32:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Instance spawned successfully.
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:41 user nova-compute[75239]: INFO nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Took 12.04 seconds to spawn the instance on the hypervisor.
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating instance_info_cache with network_info: [{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Releasing lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Instance network_info: |[{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-287a604d-3dc5-4f54-95c7-be392746ce01 req-02dd3975-87af-4c17-82a7-12f5c1001cbd service nova] Acquired lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.neutron [req-287a604d-3dc5-4f54-95c7-be392746ce01 req-02dd3975-87af-4c17-82a7-12f5c1001cbd service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Refreshing network info cache for port 8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Start _get_guest_xml network_info=[{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:32:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-616704806',display_name='tempest-ServerStableDeviceRescueTest-server-616704806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-616704806',id=5,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNyr6IAcaCWhTnd0M31N5isR2JfZGlfnnpnSCe2iTutyciIj40lB+x3H5rvcMVdsmn5oFtO37aMp9V7yFAx+Kfzowav3xLguTou77n7NO1lviCmuoo+BE+hwWUoq0BqMA==',key_name='tempest-keypair-2109943276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce07a49816064edfbf14f89b5895e9e5',ramdisk_id='',reservation_id='r-hbacdswg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-456666962',owner_user_name='tempest-ServerStableDeviceRescueTest-456666962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66625adc0c8d4508987cc570c5ae3b32',uuid=d67fcb6b-fb37-4d04-8dab-d74370f76981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Converting VIF {"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:63:b2,bridge_name='br-int',has_traffic_filtering=True,id=8e91bea0-dea9-49f6-ac95-f485a29d5cd2,network=Network(44e91adc-ee33-4228-8854-2883d4950214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e91bea0-de') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'pci_devices' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:32:41 user nova-compute[75239]:   <uuid>d67fcb6b-fb37-4d04-8dab-d74370f76981</uuid>
Nov 13 20:32:41 user nova-compute[75239]:   <name>instance-00000005</name>
Nov 13 20:32:41 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:32:41 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:32:41 user nova-compute[75239]:   <metadata>
Nov 13 20:32:41 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:32:41 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-616704806</nova:name>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:32:41</nova:creationTime>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:32:41 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:32:41 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:owner>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:user uuid="66625adc0c8d4508987cc570c5ae3b32">tempest-ServerStableDeviceRescueTest-456666962-project-member</nova:user>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:project uuid="ce07a49816064edfbf14f89b5895e9e5">tempest-ServerStableDeviceRescueTest-456666962</nova:project>
Nov 13 20:32:41 user nova-compute[75239]:       </nova:owner>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:32:41 user nova-compute[75239]:       <nova:ports>
Nov 13 20:32:41 user nova-compute[75239]:         <nova:port uuid="8e91bea0-dea9-49f6-ac95-f485a29d5cd2">
Nov 13 20:32:41 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 20:32:41 user nova-compute[75239]:         </nova:port>
Nov 13 20:32:41 user nova-compute[75239]:       </nova:ports>
Nov 13 20:32:41 user nova-compute[75239]:     </nova:instance>
Nov 13 20:32:41 user nova-compute[75239]:   </metadata>
Nov 13 20:32:41 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:32:41 user nova-compute[75239]:     <system>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="serial">d67fcb6b-fb37-4d04-8dab-d74370f76981</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="uuid">d67fcb6b-fb37-4d04-8dab-d74370f76981</entry>
Nov 13 20:32:41 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:32:41 user nova-compute[75239]:     </system>
Nov 13 20:32:41 user nova-compute[75239]:   </sysinfo>
Nov 13 20:32:41 user nova-compute[75239]:   <os>
Nov 13 20:32:41 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:32:41 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:32:41 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:32:41 user nova-compute[75239]:   </os>
Nov 13 20:32:41 user nova-compute[75239]:   <features>
Nov 13 20:32:41 user nova-compute[75239]:     <acpi/>
Nov 13 20:32:41 user nova-compute[75239]:     <apic/>
Nov 13 20:32:41 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:32:41 user nova-compute[75239]:   </features>
Nov 13 20:32:41 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:32:41 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:32:41 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:32:41 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:32:41 user nova-compute[75239]:   </clock>
Nov 13 20:32:41 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:32:41 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:32:41 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:32:41 user nova-compute[75239]:   </cpu>
Nov 13 20:32:41 user nova-compute[75239]:   <devices>
Nov 13 20:32:41 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:32:41 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:32:41 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk"/>
Nov 13 20:32:41 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:32:41 user nova-compute[75239]:     </disk>
Nov 13 20:32:41 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:32:41 user nova-compute[75239]:       <mac address="fa:16:3e:64:63:b2"/>
Nov 13 20:32:41 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:41 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:32:41 user nova-compute[75239]:       <target dev="tap8e91bea0-de"/>
Nov 13 20:32:41 user nova-compute[75239]:     </interface>
Nov 13 20:32:41 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:32:41 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/console.log" append="off"/>
Nov 13 20:32:41 user nova-compute[75239]:     </serial>
Nov 13 20:32:41 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:32:41 user nova-compute[75239]:     <video>
Nov 13 20:32:41 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:41 user nova-compute[75239]:     </video>
Nov 13 20:32:41 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:32:41 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:32:41 user nova-compute[75239]:     </rng>
Nov 13 20:32:41 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:32:41 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:32:41 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:32:41 user nova-compute[75239]:     </memballoon>
Nov 13 20:32:41 user nova-compute[75239]:   </devices>
Nov 13 20:32:41 user nova-compute[75239]: </domain>
Nov 13 20:32:41 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-616704806',display_name='tempest-ServerStableDeviceRescueTest-server-616704806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-616704806',id=5,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNyr6IAcaCWhTnd0M31N5isR2JfZGlfnnpnSCe2iTutyciIj40lB+x3H5rvcMVdsmn5oFtO37aMp9V7yFAx+Kfzowav3xLguTou77n7NO1lviCmuoo+BE+hwWUoq0BqMA==',key_name='tempest-keypair-2109943276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce07a49816064edfbf14f89b5895e9e5',ramdisk_id='',reservation_id='r-hbacdswg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-456666962',owner_user_name='tempest-ServerStableDeviceRescueTest-456666962-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66625adc0c8d4508987cc570c5ae3b32',uuid=d67fcb6b-fb37-4d04-8dab-d74370f76981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Converting VIF {"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:63:b2,bridge_name='br-int',has_traffic_filtering=True,id=8e91bea0-dea9-49f6-ac95-f485a29d5cd2,network=Network(44e91adc-ee33-4228-8854-2883d4950214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e91bea0-de') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG os_vif [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:63:b2,bridge_name='br-int',has_traffic_filtering=True,id=8e91bea0-dea9-49f6-ac95-f485a29d5cd2,network=Network(44e91adc-ee33-4228-8854-2883d4950214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e91bea0-de') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf4e43a9-97cb-54c1-a57a-bea3a5dff2a3', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: INFO nova.compute.manager [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Took 13.26 seconds to build instance.
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e91bea0-de, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e91bea0-de, col_values=(('qos', UUID('5c7f83ed-bcfc-4dfd-bc47-cfa543b432aa')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e91bea0-de, col_values=(('external_ids', {'iface-id': '8e91bea0-dea9-49f6-ac95-f485a29d5cd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:63:b2', 'vm-uuid': 'd67fcb6b-fb37-4d04-8dab-d74370f76981'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e12701d-2022-430d-86fb-a634b7fbf99a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.508s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:41 user nova-compute[75239]: INFO os_vif [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:63:b2,bridge_name='br-int',has_traffic_filtering=True,id=8e91bea0-dea9-49f6-ac95-f485a29d5cd2,network=Network(44e91adc-ee33-4228-8854-2883d4950214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e91bea0-de')
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] No VIF found with MAC fa:16:3e:64:63:b2, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Successfully updated port: 0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquired lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-38071b7a-b531-4af7-bd6d-da4a7b0192c3 req-d6a51892-0eb8-4b09-a8e7-17968fe2b89a service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received event network-changed-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-38071b7a-b531-4af7-bd6d-da4a7b0192c3 req-d6a51892-0eb8-4b09-a8e7-17968fe2b89a service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Refreshing instance network info cache due to event network-changed-0da27379-6537-4987-ad38-12e5e1d9f277. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-38071b7a-b531-4af7-bd6d-da4a7b0192c3 req-d6a51892-0eb8-4b09-a8e7-17968fe2b89a service nova] Acquiring lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Successfully updated port: 300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquired lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-287a604d-3dc5-4f54-95c7-be392746ce01 req-02dd3975-87af-4c17-82a7-12f5c1001cbd service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updated VIF entry in instance network info cache for port 8e91bea0-dea9-49f6-ac95-f485a29d5cd2. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-287a604d-3dc5-4f54-95c7-be392746ce01 req-02dd3975-87af-4c17-82a7-12f5c1001cbd service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating instance_info_cache with network_info: [{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-287a604d-3dc5-4f54-95c7-be392746ce01 req-02dd3975-87af-4c17-82a7-12f5c1001cbd service nova] Releasing lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-f67a7538-a6cd-480f-b96d-433764ffbd5b req-b186c4e9-aad6-4385-853f-4dea354347e4 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updated VIF entry in instance network info cache for port af2c8770-f7b4-4446-8061-7c377b8ad1f5. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:32:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-f67a7538-a6cd-480f-b96d-433764ffbd5b req-b186c4e9-aad6-4385-853f-4dea354347e4 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating instance_info_cache with network_info: [{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f67a7538-a6cd-480f-b96d-433764ffbd5b req-b186c4e9-aad6-4385-853f-4dea354347e4 service nova] Releasing lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updating instance_info_cache with network_info: [{"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Releasing lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Instance network_info: |[{"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-38071b7a-b531-4af7-bd6d-da4a7b0192c3 req-d6a51892-0eb8-4b09-a8e7-17968fe2b89a service nova] Acquired lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.neutron [req-38071b7a-b531-4af7-bd6d-da4a7b0192c3 req-d6a51892-0eb8-4b09-a8e7-17968fe2b89a service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Refreshing network info cache for port 0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Start _get_guest_xml network_info=[{"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:32:43 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:43 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-572482723',display_name='tempest-ServerActionsTestOtherA-server-572482723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-572482723',id=3,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx37q9vY0QYlo3fI5aFH9X6d2hNyPjTGXNNUmCr6ibGa/Kc1ClaPlhMidaIIsV7Y1igpikXwuCDpafpWPc5/9hzW0qq+/XK1xQPQ4kHZy5qMv84+zHN9XJn4hcGarD9Lw==',key_name='tempest-keypair-1127026760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-uccb7jxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=36c1f1d7-f3f9-4d41-b116-babf44d80f34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:9d:7a,bridge_name='br-int',has_traffic_filtering=True,id=0da27379-6537-4987-ad38-12e5e1d9f277,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da27379-65') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'pci_devices' on Instance uuid 36c1f1d7-f3f9-4d41-b116-babf44d80f34 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:32:43 user nova-compute[75239]:   <uuid>36c1f1d7-f3f9-4d41-b116-babf44d80f34</uuid>
Nov 13 20:32:43 user nova-compute[75239]:   <name>instance-00000003</name>
Nov 13 20:32:43 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:32:43 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:32:43 user nova-compute[75239]:   <metadata>
Nov 13 20:32:43 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:32:43 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:name>tempest-ServerActionsTestOtherA-server-572482723</nova:name>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:32:43</nova:creationTime>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:32:43 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:32:43 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:owner>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:user uuid="3d8ae2d158f94548bc3d9873317935cd">tempest-ServerActionsTestOtherA-1210141142-project-member</nova:user>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:project uuid="e14ce616b1ad4ee7934e34bad1fdf6a3">tempest-ServerActionsTestOtherA-1210141142</nova:project>
Nov 13 20:32:43 user nova-compute[75239]:       </nova:owner>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:ports>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:port uuid="0da27379-6537-4987-ad38-12e5e1d9f277">
Nov 13 20:32:43 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 20:32:43 user nova-compute[75239]:         </nova:port>
Nov 13 20:32:43 user nova-compute[75239]:       </nova:ports>
Nov 13 20:32:43 user nova-compute[75239]:     </nova:instance>
Nov 13 20:32:43 user nova-compute[75239]:   </metadata>
Nov 13 20:32:43 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:32:43 user nova-compute[75239]:     <system>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="serial">36c1f1d7-f3f9-4d41-b116-babf44d80f34</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="uuid">36c1f1d7-f3f9-4d41-b116-babf44d80f34</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:32:43 user nova-compute[75239]:     </system>
Nov 13 20:32:43 user nova-compute[75239]:   </sysinfo>
Nov 13 20:32:43 user nova-compute[75239]:   <os>
Nov 13 20:32:43 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:32:43 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:32:43 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:32:43 user nova-compute[75239]:   </os>
Nov 13 20:32:43 user nova-compute[75239]:   <features>
Nov 13 20:32:43 user nova-compute[75239]:     <acpi/>
Nov 13 20:32:43 user nova-compute[75239]:     <apic/>
Nov 13 20:32:43 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:32:43 user nova-compute[75239]:   </features>
Nov 13 20:32:43 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:32:43 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:32:43 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:32:43 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:32:43 user nova-compute[75239]:   </clock>
Nov 13 20:32:43 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:32:43 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:32:43 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:32:43 user nova-compute[75239]:   </cpu>
Nov 13 20:32:43 user nova-compute[75239]:   <devices>
Nov 13 20:32:43 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:32:43 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:32:43 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk"/>
Nov 13 20:32:43 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:32:43 user nova-compute[75239]:     </disk>
Nov 13 20:32:43 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:32:43 user nova-compute[75239]:       <mac address="fa:16:3e:fc:9d:7a"/>
Nov 13 20:32:43 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:43 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:32:43 user nova-compute[75239]:       <target dev="tap0da27379-65"/>
Nov 13 20:32:43 user nova-compute[75239]:     </interface>
Nov 13 20:32:43 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:32:43 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/console.log" append="off"/>
Nov 13 20:32:43 user nova-compute[75239]:     </serial>
Nov 13 20:32:43 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:32:43 user nova-compute[75239]:     <video>
Nov 13 20:32:43 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:43 user nova-compute[75239]:     </video>
Nov 13 20:32:43 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:32:43 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:32:43 user nova-compute[75239]:     </rng>
Nov 13 20:32:43 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:32:43 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:32:43 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:32:43 user nova-compute[75239]:     </memballoon>
Nov 13 20:32:43 user nova-compute[75239]:   </devices>
Nov 13 20:32:43 user nova-compute[75239]: </domain>
Nov 13 20:32:43 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-572482723',display_name='tempest-ServerActionsTestOtherA-server-572482723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-572482723',id=3,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx37q9vY0QYlo3fI5aFH9X6d2hNyPjTGXNNUmCr6ibGa/Kc1ClaPlhMidaIIsV7Y1igpikXwuCDpafpWPc5/9hzW0qq+/XK1xQPQ4kHZy5qMv84+zHN9XJn4hcGarD9Lw==',key_name='tempest-keypair-1127026760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-uccb7jxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=36c1f1d7-f3f9-4d41-b116-babf44d80f34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:9d:7a,bridge_name='br-int',has_traffic_filtering=True,id=0da27379-6537-4987-ad38-12e5e1d9f277,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da27379-65') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG os_vif [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:9d:7a,bridge_name='br-int',has_traffic_filtering=True,id=0da27379-6537-4987-ad38-12e5e1d9f277,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da27379-65') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4cf863b5-6e75-55c7-9381-0fdc92aa799d', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0da27379-65, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0da27379-65, col_values=(('qos', UUID('994ba2b5-b773-4063-8757-f0049368e874')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0da27379-65, col_values=(('external_ids', {'iface-id': '0da27379-6537-4987-ad38-12e5e1d9f277', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:9d:7a', 'vm-uuid': '36c1f1d7-f3f9-4d41-b116-babf44d80f34'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: INFO os_vif [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:9d:7a,bridge_name='br-int',has_traffic_filtering=True,id=0da27379-6537-4987-ad38-12e5e1d9f277,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da27379-65')
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updating instance_info_cache with network_info: [{"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Releasing lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Instance network_info: |[{"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Start _get_guest_xml network_info=[{"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:32:43 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:43 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No VIF found with MAC fa:16:3e:fc:9d:7a, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-38824528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-38824528',id=4,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-xb41uftk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:36Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=d816fbc5-c148-472b-9ade-c0175ccb38e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=300851ce-3a22-4abf-a2b6-4a3d5bde094e,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300851ce-3a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.objects.instance [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'pci_devices' on Instance uuid d816fbc5-c148-472b-9ade-c0175ccb38e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:32:43 user nova-compute[75239]:   <uuid>d816fbc5-c148-472b-9ade-c0175ccb38e0</uuid>
Nov 13 20:32:43 user nova-compute[75239]:   <name>instance-00000004</name>
Nov 13 20:32:43 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:32:43 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:32:43 user nova-compute[75239]:   <metadata>
Nov 13 20:32:43 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:32:43 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-38824528</nova:name>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:32:43</nova:creationTime>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:32:43 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:32:43 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:owner>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:user uuid="2669d647fe6f4034bc70703546345eb3">tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member</nova:user>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:project uuid="f465510aec2849dfb0917120a772f066">tempest-ServerBootFromVolumeStableRescueTest-2033691872</nova:project>
Nov 13 20:32:43 user nova-compute[75239]:       </nova:owner>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:32:43 user nova-compute[75239]:       <nova:ports>
Nov 13 20:32:43 user nova-compute[75239]:         <nova:port uuid="300851ce-3a22-4abf-a2b6-4a3d5bde094e">
Nov 13 20:32:43 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:32:43 user nova-compute[75239]:         </nova:port>
Nov 13 20:32:43 user nova-compute[75239]:       </nova:ports>
Nov 13 20:32:43 user nova-compute[75239]:     </nova:instance>
Nov 13 20:32:43 user nova-compute[75239]:   </metadata>
Nov 13 20:32:43 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:32:43 user nova-compute[75239]:     <system>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="serial">d816fbc5-c148-472b-9ade-c0175ccb38e0</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="uuid">d816fbc5-c148-472b-9ade-c0175ccb38e0</entry>
Nov 13 20:32:43 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:32:43 user nova-compute[75239]:     </system>
Nov 13 20:32:43 user nova-compute[75239]:   </sysinfo>
Nov 13 20:32:43 user nova-compute[75239]:   <os>
Nov 13 20:32:43 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:32:43 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:32:43 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:32:43 user nova-compute[75239]:   </os>
Nov 13 20:32:43 user nova-compute[75239]:   <features>
Nov 13 20:32:43 user nova-compute[75239]:     <acpi/>
Nov 13 20:32:43 user nova-compute[75239]:     <apic/>
Nov 13 20:32:43 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:32:43 user nova-compute[75239]:   </features>
Nov 13 20:32:43 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:32:43 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:32:43 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:32:43 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:32:43 user nova-compute[75239]:   </clock>
Nov 13 20:32:43 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:32:43 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:32:43 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:32:43 user nova-compute[75239]:   </cpu>
Nov 13 20:32:43 user nova-compute[75239]:   <devices>
Nov 13 20:32:43 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:32:43 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:32:43 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk"/>
Nov 13 20:32:43 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:32:43 user nova-compute[75239]:     </disk>
Nov 13 20:32:43 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:32:43 user nova-compute[75239]:       <mac address="fa:16:3e:c3:4d:66"/>
Nov 13 20:32:43 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:43 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:32:43 user nova-compute[75239]:       <target dev="tap300851ce-3a"/>
Nov 13 20:32:43 user nova-compute[75239]:     </interface>
Nov 13 20:32:43 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:32:43 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/console.log" append="off"/>
Nov 13 20:32:43 user nova-compute[75239]:     </serial>
Nov 13 20:32:43 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:32:43 user nova-compute[75239]:     <video>
Nov 13 20:32:43 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:43 user nova-compute[75239]:     </video>
Nov 13 20:32:43 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:32:43 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:32:43 user nova-compute[75239]:     </rng>
Nov 13 20:32:43 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:32:43 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:32:43 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:32:43 user nova-compute[75239]:     </memballoon>
Nov 13 20:32:43 user nova-compute[75239]:   </devices>
Nov 13 20:32:43 user nova-compute[75239]: </domain>
Nov 13 20:32:43 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-38824528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-38824528',id=4,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-xb41uftk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:36Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=d816fbc5-c148-472b-9ade-c0175ccb38e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=300851ce-3a22-4abf-a2b6-4a3d5bde094e,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300851ce-3a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG os_vif [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=300851ce-3a22-4abf-a2b6-4a3d5bde094e,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300851ce-3a') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd21efad1-e79a-5798-b6ce-8366ad47591e', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap300851ce-3a, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap300851ce-3a, col_values=(('qos', UUID('9161d32b-a0ef-416a-8dea-430862a9d78f')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap300851ce-3a, col_values=(('external_ids', {'iface-id': '300851ce-3a22-4abf-a2b6-4a3d5bde094e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:4d:66', 'vm-uuid': 'd816fbc5-c148-472b-9ade-c0175ccb38e0'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:44 user nova-compute[75239]: INFO os_vif [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=300851ce-3a22-4abf-a2b6-4a3d5bde094e,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300851ce-3a')
Nov 13 20:32:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No VIF found with MAC fa:16:3e:c3:4d:66, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-5c7f0823-fda7-4422-9065-152b44f3c198 req-bbfe75bc-3209-49cc-9394-4b0e946f4564 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received event network-changed-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-5c7f0823-fda7-4422-9065-152b44f3c198 req-bbfe75bc-3209-49cc-9394-4b0e946f4564 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Refreshing instance network info cache due to event network-changed-300851ce-3a22-4abf-a2b6-4a3d5bde094e. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5c7f0823-fda7-4422-9065-152b44f3c198 req-bbfe75bc-3209-49cc-9394-4b0e946f4564 service nova] Acquiring lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5c7f0823-fda7-4422-9065-152b44f3c198 req-bbfe75bc-3209-49cc-9394-4b0e946f4564 service nova] Acquired lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-5c7f0823-fda7-4422-9065-152b44f3c198 req-bbfe75bc-3209-49cc-9394-4b0e946f4564 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Refreshing network info cache for port 300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-38071b7a-b531-4af7-bd6d-da4a7b0192c3 req-d6a51892-0eb8-4b09-a8e7-17968fe2b89a service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updated VIF entry in instance network info cache for port 0da27379-6537-4987-ad38-12e5e1d9f277. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-38071b7a-b531-4af7-bd6d-da4a7b0192c3 req-d6a51892-0eb8-4b09-a8e7-17968fe2b89a service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updating instance_info_cache with network_info: [{"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-38071b7a-b531-4af7-bd6d-da4a7b0192c3 req-d6a51892-0eb8-4b09-a8e7-17968fe2b89a service nova] Releasing lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:45 user nova-compute[75239]: DEBUG nova.network.neutron [req-5c7f0823-fda7-4422-9065-152b44f3c198 req-bbfe75bc-3209-49cc-9394-4b0e946f4564 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updated VIF entry in instance network info cache for port 300851ce-3a22-4abf-a2b6-4a3d5bde094e. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:32:45 user nova-compute[75239]: DEBUG nova.network.neutron [req-5c7f0823-fda7-4422-9065-152b44f3c198 req-bbfe75bc-3209-49cc-9394-4b0e946f4564 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updating instance_info_cache with network_info: [{"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5c7f0823-fda7-4422-9065-152b44f3c198 req-bbfe75bc-3209-49cc-9394-4b0e946f4564 service nova] Releasing lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:32:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Instance spawned successfully.
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:49 user nova-compute[75239]: INFO nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Took 11.56 seconds to spawn the instance on the hypervisor.
Nov 13 20:32:49 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:32:49 user nova-compute[75239]: INFO nova.compute.manager [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Took 12.37 seconds to build instance.
Nov 13 20:32:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6201a59a-a820-4dc3-bbdb-2cfe9e71c5c8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.495s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:32:50 user nova-compute[75239]: INFO nova.compute.claims [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Claim successful on node user
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:32:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance spawned successfully.
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:32:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Instance spawned successfully.
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:32:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Instance spawned successfully.
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:32:51 user nova-compute[75239]: INFO nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Took 18.07 seconds to spawn the instance on the hypervisor.
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:32:51 user nova-compute[75239]: INFO nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Took 16.00 seconds to spawn the instance on the hypervisor.
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.842s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:32:51 user nova-compute[75239]: INFO nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Took 16.78 seconds to spawn the instance on the hypervisor.
Nov 13 20:32:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:32:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:32:52 user nova-compute[75239]: INFO nova.compute.manager [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Took 19.51 seconds to build instance.
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f6714cd7-78e6-4388-bc0f-e7edb8586d01 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.714s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:52 user nova-compute[75239]: INFO nova.compute.manager [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Took 17.52 seconds to build instance.
Nov 13 20:32:52 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb4e6e0c-4d80-47e2-a0a9-b03e4800844d tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.697s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:52 user nova-compute[75239]: INFO nova.compute.manager [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Took 17.98 seconds to build instance.
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fc56107-1fe4-4df6-b458-f41df9a98350 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.168s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:32:52 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Creating image(s)
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "/opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "/opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG nova.policy [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '781343c1a6e94234bef9a8d11cea0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd5f6a62ab945aead252eec2f72112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.284s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.233s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk 1073741824" returned: 0 in 0.100s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.228s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Cannot resize image /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Ensure instance console log exists: /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Successfully created port: d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:32:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Successfully updated port: d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:32:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "refresh_cache-ae8531d9-3930-4373-91b2-628d850e8ba7" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquired lock "refresh_cache-ae8531d9-3930-4373-91b2-628d850e8ba7" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:32:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-50965d13-e5b0-4de7-be1f-096f9e460ac8 req-f244f365-5c9a-4944-b10b-f7a787890733 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received event network-changed-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:32:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-50965d13-e5b0-4de7-be1f-096f9e460ac8 req-f244f365-5c9a-4944-b10b-f7a787890733 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Refreshing instance network info cache due to event network-changed-d7bfe0e9-fe15-4a8f-b258-e0ab32209397. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:32:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-50965d13-e5b0-4de7-be1f-096f9e460ac8 req-f244f365-5c9a-4944-b10b-f7a787890733 service nova] Acquiring lock "refresh_cache-ae8531d9-3930-4373-91b2-628d850e8ba7" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Updating instance_info_cache with network_info: [{"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Releasing lock "refresh_cache-ae8531d9-3930-4373-91b2-628d850e8ba7" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Instance network_info: |[{"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-50965d13-e5b0-4de7-be1f-096f9e460ac8 req-f244f365-5c9a-4944-b10b-f7a787890733 service nova] Acquired lock "refresh_cache-ae8531d9-3930-4373-91b2-628d850e8ba7" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.network.neutron [req-50965d13-e5b0-4de7-be1f-096f9e460ac8 req-f244f365-5c9a-4944-b10b-f7a787890733 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Refreshing network info cache for port d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Start _get_guest_xml network_info=[{"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:32:56 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:56 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1368869872',display_name='tempest-VolumesAdminNegativeTest-server-1368869872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1368869872',id=6,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfi+bbzoY150SRmMbpbpUG0AgdZjRyoN52REv5In3OeDpxG0Szy5ziB2DjupfYCUs1xMy41cA8vRxYXO2ehkMMy2qXMfv2b1AqD2RyHfWREKj4ToppHWnJVGhOPrRyXrg==',key_name='tempest-keypair-1874323935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edd5f6a62ab945aead252eec2f72112b',ramdisk_id='',reservation_id='r-gmvgd2sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1388057922',owner_user_name='tempest-VolumesAdminNegativeTest-1388057922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='781343c1a6e94234bef9a8d11cea0f9c',uuid=ae8531d9-3930-4373-91b2-628d850e8ba7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converting VIF {"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:da:7a,bridge_name='br-int',has_traffic_filtering=True,id=d7bfe0e9-fe15-4a8f-b258-e0ab32209397,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bfe0e9-fe') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lazy-loading 'pci_devices' on Instance uuid ae8531d9-3930-4373-91b2-628d850e8ba7 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:32:56 user nova-compute[75239]:   <uuid>ae8531d9-3930-4373-91b2-628d850e8ba7</uuid>
Nov 13 20:32:56 user nova-compute[75239]:   <name>instance-00000006</name>
Nov 13 20:32:56 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:32:56 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:32:56 user nova-compute[75239]:   <metadata>
Nov 13 20:32:56 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:32:56 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:32:56 user nova-compute[75239]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1368869872</nova:name>
Nov 13 20:32:56 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:32:56</nova:creationTime>
Nov 13 20:32:56 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:32:56 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:32:56 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:32:56 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:32:56 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:32:56 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:32:56 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:32:56 user nova-compute[75239]:       <nova:owner>
Nov 13 20:32:56 user nova-compute[75239]:         <nova:user uuid="781343c1a6e94234bef9a8d11cea0f9c">tempest-VolumesAdminNegativeTest-1388057922-project-member</nova:user>
Nov 13 20:32:56 user nova-compute[75239]:         <nova:project uuid="edd5f6a62ab945aead252eec2f72112b">tempest-VolumesAdminNegativeTest-1388057922</nova:project>
Nov 13 20:32:56 user nova-compute[75239]:       </nova:owner>
Nov 13 20:32:56 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:32:56 user nova-compute[75239]:       <nova:ports>
Nov 13 20:32:56 user nova-compute[75239]:         <nova:port uuid="d7bfe0e9-fe15-4a8f-b258-e0ab32209397">
Nov 13 20:32:56 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:32:56 user nova-compute[75239]:         </nova:port>
Nov 13 20:32:56 user nova-compute[75239]:       </nova:ports>
Nov 13 20:32:56 user nova-compute[75239]:     </nova:instance>
Nov 13 20:32:56 user nova-compute[75239]:   </metadata>
Nov 13 20:32:56 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:32:56 user nova-compute[75239]:     <system>
Nov 13 20:32:56 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:32:56 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:32:56 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:32:56 user nova-compute[75239]:       <entry name="serial">ae8531d9-3930-4373-91b2-628d850e8ba7</entry>
Nov 13 20:32:56 user nova-compute[75239]:       <entry name="uuid">ae8531d9-3930-4373-91b2-628d850e8ba7</entry>
Nov 13 20:32:56 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:32:56 user nova-compute[75239]:     </system>
Nov 13 20:32:56 user nova-compute[75239]:   </sysinfo>
Nov 13 20:32:56 user nova-compute[75239]:   <os>
Nov 13 20:32:56 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:32:56 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:32:56 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:32:56 user nova-compute[75239]:   </os>
Nov 13 20:32:56 user nova-compute[75239]:   <features>
Nov 13 20:32:56 user nova-compute[75239]:     <acpi/>
Nov 13 20:32:56 user nova-compute[75239]:     <apic/>
Nov 13 20:32:56 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:32:56 user nova-compute[75239]:   </features>
Nov 13 20:32:56 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:32:56 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:32:56 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:32:56 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:32:56 user nova-compute[75239]:   </clock>
Nov 13 20:32:56 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:32:56 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:32:56 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:32:56 user nova-compute[75239]:   </cpu>
Nov 13 20:32:56 user nova-compute[75239]:   <devices>
Nov 13 20:32:56 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:32:56 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:32:56 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk"/>
Nov 13 20:32:56 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:32:56 user nova-compute[75239]:     </disk>
Nov 13 20:32:56 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:32:56 user nova-compute[75239]:       <mac address="fa:16:3e:25:da:7a"/>
Nov 13 20:32:56 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:56 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:32:56 user nova-compute[75239]:       <target dev="tapd7bfe0e9-fe"/>
Nov 13 20:32:56 user nova-compute[75239]:     </interface>
Nov 13 20:32:56 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:32:56 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/console.log" append="off"/>
Nov 13 20:32:56 user nova-compute[75239]:     </serial>
Nov 13 20:32:56 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:32:56 user nova-compute[75239]:     <video>
Nov 13 20:32:56 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:32:56 user nova-compute[75239]:     </video>
Nov 13 20:32:56 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:32:56 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:32:56 user nova-compute[75239]:     </rng>
Nov 13 20:32:56 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:32:56 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:32:56 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:32:56 user nova-compute[75239]:     </memballoon>
Nov 13 20:32:56 user nova-compute[75239]:   </devices>
Nov 13 20:32:56 user nova-compute[75239]: </domain>
Nov 13 20:32:56 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1368869872',display_name='tempest-VolumesAdminNegativeTest-server-1368869872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1368869872',id=6,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfi+bbzoY150SRmMbpbpUG0AgdZjRyoN52REv5In3OeDpxG0Szy5ziB2DjupfYCUs1xMy41cA8vRxYXO2ehkMMy2qXMfv2b1AqD2RyHfWREKj4ToppHWnJVGhOPrRyXrg==',key_name='tempest-keypair-1874323935',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edd5f6a62ab945aead252eec2f72112b',ramdisk_id='',reservation_id='r-gmvgd2sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1388057922',owner_user_name='tempest-VolumesAdminNegativeTest-1388057922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='781343c1a6e94234bef9a8d11cea0f9c',uuid=ae8531d9-3930-4373-91b2-628d850e8ba7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converting VIF {"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:da:7a,bridge_name='br-int',has_traffic_filtering=True,id=d7bfe0e9-fe15-4a8f-b258-e0ab32209397,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bfe0e9-fe') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG os_vif [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:da:7a,bridge_name='br-int',has_traffic_filtering=True,id=d7bfe0e9-fe15-4a8f-b258-e0ab32209397,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bfe0e9-fe') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae3407a6-6866-5096-b1bb-6c8d85f19a86', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7bfe0e9-fe, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7bfe0e9-fe, col_values=(('qos', UUID('0b4dceee-ddef-4d5f-885b-f4da212aefff')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7bfe0e9-fe, col_values=(('external_ids', {'iface-id': 'd7bfe0e9-fe15-4a8f-b258-e0ab32209397', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:da:7a', 'vm-uuid': 'ae8531d9-3930-4373-91b2-628d850e8ba7'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:56 user nova-compute[75239]: INFO os_vif [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:da:7a,bridge_name='br-int',has_traffic_filtering=True,id=d7bfe0e9-fe15-4a8f-b258-e0ab32209397,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bfe0e9-fe')
Nov 13 20:32:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] No VIF found with MAC fa:16:3e:25:da:7a, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:32:57 user nova-compute[75239]: INFO nova.compute.claims [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Claim successful on node user
Nov 13 20:32:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-50965d13-e5b0-4de7-be1f-096f9e460ac8 req-f244f365-5c9a-4944-b10b-f7a787890733 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Updated VIF entry in instance network info cache for port d7bfe0e9-fe15-4a8f-b258-e0ab32209397. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-50965d13-e5b0-4de7-be1f-096f9e460ac8 req-f244f365-5c9a-4944-b10b-f7a787890733 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Updating instance_info_cache with network_info: [{"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-50965d13-e5b0-4de7-be1f-096f9e460ac8 req-f244f365-5c9a-4944-b10b-f7a787890733 service nova] Releasing lock "refresh_cache-ae8531d9-3930-4373-91b2-628d850e8ba7" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.072s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:32:57 user nova-compute[75239]: INFO nova.compute.claims [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Claim successful on node user
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:32:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:32:57 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 13 20:32:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:32:58 user nova-compute[75239]: DEBUG nova.policy [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d5dd64dc1e441a39dab812acb9aebc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b650b217c2f5436baeefc322494c2a76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:32:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:32:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:32:58 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Creating image(s)
Nov 13 20:32:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "/opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "/opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "/opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "1c93777757883336c103b47f33e6c2696f9e6cc5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "1c93777757883336c103b47f33e6c2696f9e6cc5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.486s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:32:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:32:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5.part --force-share --output=json" returned: 0 in 0.508s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.virt.images [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] 7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7 was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5.part /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Successfully created port: 4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.policy [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85e59f5a0e6642d3857838ba05dfca9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15357eef6014b2aa9783fa80a958011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:32:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Creating image(s)
Nov 13 20:32:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "/opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "/opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5.part /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5.converted" returned: 0 in 0.393s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:32:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.290s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5.converted --force-share --output=json" returned: 0 in 0.273s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "1c93777757883336c103b47f33e6c2696f9e6cc5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.734s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.228s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk 1073741824" returned: 0 in 0.058s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5 --force-share --output=json" returned: 0 in 0.316s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "1c93777757883336c103b47f33e6c2696f9e6cc5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "1c93777757883336c103b47f33e6c2696f9e6cc5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.301s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5 --force-share --output=json" returned: 0 in 0.258s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5,backing_fmt=raw /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5,backing_fmt=raw /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk 1073741824" returned: 0 in 0.076s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "1c93777757883336c103b47f33e6c2696f9e6cc5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Cannot resize image /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Ensure instance console log exists: /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5 --force-share --output=json" returned: 0 in 0.256s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Cannot resize image /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Ensure instance console log exists: /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Successfully created port: e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Successfully updated port: 4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "refresh_cache-4577b5eb-6acf-4616-931b-28b5ef72d739" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquired lock "refresh_cache-4577b5eb-6acf-4616-931b-28b5ef72d739" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-6bf9a017-5925-42d3-b3ec-f2276320e8d0 req-9e7ce597-0a0f-45eb-b30e-c7a5e9d84c45 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received event network-changed-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-6bf9a017-5925-42d3-b3ec-f2276320e8d0 req-9e7ce597-0a0f-45eb-b30e-c7a5e9d84c45 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Refreshing instance network info cache due to event network-changed-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6bf9a017-5925-42d3-b3ec-f2276320e8d0 req-9e7ce597-0a0f-45eb-b30e-c7a5e9d84c45 service nova] Acquiring lock "refresh_cache-4577b5eb-6acf-4616-931b-28b5ef72d739" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:33:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Instance spawned successfully.
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:01 user nova-compute[75239]: INFO nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Took 9.61 seconds to spawn the instance on the hypervisor.
Nov 13 20:33:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:33:02 user nova-compute[75239]: INFO nova.compute.manager [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Took 11.28 seconds to build instance.
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b15de9f0-267d-42c1-8be2-2fbf9ee719cc tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.449s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Updating instance_info_cache with network_info: [{"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Releasing lock "refresh_cache-4577b5eb-6acf-4616-931b-28b5ef72d739" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Instance network_info: |[{"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6bf9a017-5925-42d3-b3ec-f2276320e8d0 req-9e7ce597-0a0f-45eb-b30e-c7a5e9d84c45 service nova] Acquired lock "refresh_cache-4577b5eb-6acf-4616-931b-28b5ef72d739" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.network.neutron [req-6bf9a017-5925-42d3-b3ec-f2276320e8d0 req-9e7ce597-0a0f-45eb-b30e-c7a5e9d84c45 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Refreshing network info cache for port 4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Start _get_guest_xml network_info=[{"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:32:48Z,direct_url=<?>,disk_format='qcow2',id=7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7,min_disk=0,min_ram=0,name='',owner='842b4b7db95d421fb354b90409ec31f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:32:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:33:02 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:02 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:32:48Z,direct_url=<?>,disk_format='qcow2',id=7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7,min_disk=0,min_ram=0,name='',owner='842b4b7db95d421fb354b90409ec31f6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:32:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2124856528',display_name='tempest-AttachSCSIVolumeTestJSON-server-2124856528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2124856528',id=7,image_ref='7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZphExKZl6gh5qPUnu8di50lFhI3WWQLNHlBXKBGEl/L7r0dgQaeGlDbm3hHPjbDSQuFJIFqikJPa/B9gZjUutk7tzxjYdpLatmUjIwU5O4lbiAYA50m6VzH+TSstPbSg==',key_name='tempest-keypair-1516787880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b650b217c2f5436baeefc322494c2a76',ramdisk_id='',reservation_id='r-n70g0sdi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-118785139',owner_user_name='tempest-AttachSCSIVolumeTestJSON-118785139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d5dd64dc1e441a39dab812acb9aebc3',uuid=4577b5eb-6acf-4616-931b-28b5ef72d739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Converting VIF {"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:42:e7,bridge_name='br-int',has_traffic_filtering=True,id=4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea,network=Network(4371c00a-d55d-4642-842e-8c8b60c626fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbf4711-14') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lazy-loading 'pci_devices' on Instance uuid 4577b5eb-6acf-4616-931b-28b5ef72d739 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:33:02 user nova-compute[75239]:   <uuid>4577b5eb-6acf-4616-931b-28b5ef72d739</uuid>
Nov 13 20:33:02 user nova-compute[75239]:   <name>instance-00000007</name>
Nov 13 20:33:02 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:33:02 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:33:02 user nova-compute[75239]:   <metadata>
Nov 13 20:33:02 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:33:02 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:33:02 user nova-compute[75239]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2124856528</nova:name>
Nov 13 20:33:02 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:33:02</nova:creationTime>
Nov 13 20:33:02 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:33:02 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:33:02 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:33:02 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:33:02 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:33:02 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:33:02 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:33:02 user nova-compute[75239]:       <nova:owner>
Nov 13 20:33:02 user nova-compute[75239]:         <nova:user uuid="4d5dd64dc1e441a39dab812acb9aebc3">tempest-AttachSCSIVolumeTestJSON-118785139-project-member</nova:user>
Nov 13 20:33:02 user nova-compute[75239]:         <nova:project uuid="b650b217c2f5436baeefc322494c2a76">tempest-AttachSCSIVolumeTestJSON-118785139</nova:project>
Nov 13 20:33:02 user nova-compute[75239]:       </nova:owner>
Nov 13 20:33:02 user nova-compute[75239]:       <nova:root type="image" uuid="7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7"/>
Nov 13 20:33:02 user nova-compute[75239]:       <nova:ports>
Nov 13 20:33:02 user nova-compute[75239]:         <nova:port uuid="4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea">
Nov 13 20:33:02 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 20:33:02 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:02 user nova-compute[75239]:       </nova:ports>
Nov 13 20:33:02 user nova-compute[75239]:     </nova:instance>
Nov 13 20:33:02 user nova-compute[75239]:   </metadata>
Nov 13 20:33:02 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:33:02 user nova-compute[75239]:     <system>
Nov 13 20:33:02 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:33:02 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:33:02 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:33:02 user nova-compute[75239]:       <entry name="serial">4577b5eb-6acf-4616-931b-28b5ef72d739</entry>
Nov 13 20:33:02 user nova-compute[75239]:       <entry name="uuid">4577b5eb-6acf-4616-931b-28b5ef72d739</entry>
Nov 13 20:33:02 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:33:02 user nova-compute[75239]:     </system>
Nov 13 20:33:02 user nova-compute[75239]:   </sysinfo>
Nov 13 20:33:02 user nova-compute[75239]:   <os>
Nov 13 20:33:02 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:33:02 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:33:02 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:33:02 user nova-compute[75239]:   </os>
Nov 13 20:33:02 user nova-compute[75239]:   <features>
Nov 13 20:33:02 user nova-compute[75239]:     <acpi/>
Nov 13 20:33:02 user nova-compute[75239]:     <apic/>
Nov 13 20:33:02 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:33:02 user nova-compute[75239]:   </features>
Nov 13 20:33:02 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:33:02 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:33:02 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:33:02 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:33:02 user nova-compute[75239]:   </clock>
Nov 13 20:33:02 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:33:02 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:33:02 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:33:02 user nova-compute[75239]:   </cpu>
Nov 13 20:33:02 user nova-compute[75239]:   <devices>
Nov 13 20:33:02 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:33:02 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:33:02 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk"/>
Nov 13 20:33:02 user nova-compute[75239]:       <target dev="sda" bus="scsi"/>
Nov 13 20:33:02 user nova-compute[75239]:       <address type="drive" controller="0" unit="0"/>
Nov 13 20:33:02 user nova-compute[75239]:     </disk>
Nov 13 20:33:02 user nova-compute[75239]:     <disk type="file" device="cdrom">
Nov 13 20:33:02 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 20:33:02 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk.config"/>
Nov 13 20:33:02 user nova-compute[75239]:       <target dev="sdb" bus="scsi"/>
Nov 13 20:33:02 user nova-compute[75239]:       <address type="drive" controller="0" unit="1"/>
Nov 13 20:33:02 user nova-compute[75239]:     </disk>
Nov 13 20:33:02 user nova-compute[75239]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 13 20:33:02 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:02 user nova-compute[75239]:       <mac address="fa:16:3e:9a:42:e7"/>
Nov 13 20:33:02 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:02 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:02 user nova-compute[75239]:       <target dev="tap4cbf4711-14"/>
Nov 13 20:33:02 user nova-compute[75239]:     </interface>
Nov 13 20:33:02 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:33:02 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/console.log" append="off"/>
Nov 13 20:33:02 user nova-compute[75239]:     </serial>
Nov 13 20:33:02 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:33:02 user nova-compute[75239]:     <video>
Nov 13 20:33:02 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:02 user nova-compute[75239]:     </video>
Nov 13 20:33:02 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:33:02 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:33:02 user nova-compute[75239]:     </rng>
Nov 13 20:33:02 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:33:02 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:33:02 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:33:02 user nova-compute[75239]:     </memballoon>
Nov 13 20:33:02 user nova-compute[75239]:   </devices>
Nov 13 20:33:02 user nova-compute[75239]: </domain>
Nov 13 20:33:02 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2124856528',display_name='tempest-AttachSCSIVolumeTestJSON-server-2124856528',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2124856528',id=7,image_ref='7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZphExKZl6gh5qPUnu8di50lFhI3WWQLNHlBXKBGEl/L7r0dgQaeGlDbm3hHPjbDSQuFJIFqikJPa/B9gZjUutk7tzxjYdpLatmUjIwU5O4lbiAYA50m6VzH+TSstPbSg==',key_name='tempest-keypair-1516787880',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b650b217c2f5436baeefc322494c2a76',ramdisk_id='',reservation_id='r-n70g0sdi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-118785139',owner_user_name='tempest-AttachSCSIVolumeTestJSON-118785139-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d5dd64dc1e441a39dab812acb9aebc3',uuid=4577b5eb-6acf-4616-931b-28b5ef72d739,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Converting VIF {"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:42:e7,bridge_name='br-int',has_traffic_filtering=True,id=4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea,network=Network(4371c00a-d55d-4642-842e-8c8b60c626fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbf4711-14') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG os_vif [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:42:e7,bridge_name='br-int',has_traffic_filtering=True,id=4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea,network=Network(4371c00a-d55d-4642-842e-8c8b60c626fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbf4711-14') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ad85c15-1d56-55e3-bb2c-a0d4d0c4f2b2', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cbf4711-14, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cbf4711-14, col_values=(('qos', UUID('f92b7e78-70b5-433d-be3c-38761694a743')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cbf4711-14, col_values=(('external_ids', {'iface-id': '4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:42:e7', 'vm-uuid': '4577b5eb-6acf-4616-931b-28b5ef72d739'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:02 user nova-compute[75239]: INFO os_vif [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:42:e7,bridge_name='br-int',has_traffic_filtering=True,id=4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea,network=Network(4371c00a-d55d-4642-842e-8c8b60c626fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbf4711-14')
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] No BDM found with device name sda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:33:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] No VIF found with MAC fa:16:3e:9a:42:e7, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:33:02 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Using config drive
Nov 13 20:33:03 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Creating config drive at /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk.config
Nov 13 20:33:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphu7ptvma {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphu7ptvma" returned: 0 in 0.072s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Successfully updated port: e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "refresh_cache-ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquired lock "refresh_cache-ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-497e4850-a40a-4c31-a23d-9af119dcf378 req-86c1ff8a-df56-469c-ad81-11d25d5a22e2 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received event network-changed-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-497e4850-a40a-4c31-a23d-9af119dcf378 req-86c1ff8a-df56-469c-ad81-11d25d5a22e2 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Refreshing instance network info cache due to event network-changed-e017651b-4710-4d2f-a57a-73401f644453. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-497e4850-a40a-4c31-a23d-9af119dcf378 req-86c1ff8a-df56-469c-ad81-11d25d5a22e2 service nova] Acquiring lock "refresh_cache-ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.network.neutron [req-6bf9a017-5925-42d3-b3ec-f2276320e8d0 req-9e7ce597-0a0f-45eb-b30e-c7a5e9d84c45 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Updated VIF entry in instance network info cache for port 4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.network.neutron [req-6bf9a017-5925-42d3-b3ec-f2276320e8d0 req-9e7ce597-0a0f-45eb-b30e-c7a5e9d84c45 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Updating instance_info_cache with network_info: [{"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6bf9a017-5925-42d3-b3ec-f2276320e8d0 req-9e7ce597-0a0f-45eb-b30e-c7a5e9d84c45 service nova] Releasing lock "refresh_cache-4577b5eb-6acf-4616-931b-28b5ef72d739" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-97016dde-db44-46a5-8e69-7ab962894658 req-ea4f82ea-c6e7-4eb7-9aea-b198f1f45eee service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-97016dde-db44-46a5-8e69-7ab962894658 req-ea4f82ea-c6e7-4eb7-9aea-b198f1f45eee service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-97016dde-db44-46a5-8e69-7ab962894658 req-ea4f82ea-c6e7-4eb7-9aea-b198f1f45eee service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-97016dde-db44-46a5-8e69-7ab962894658 req-ea4f82ea-c6e7-4eb7-9aea-b198f1f45eee service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.009s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-97016dde-db44-46a5-8e69-7ab962894658 req-ea4f82ea-c6e7-4eb7-9aea-b198f1f45eee service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:04 user nova-compute[75239]: WARNING nova.compute.manager [req-97016dde-db44-46a5-8e69-7ab962894658 req-ea4f82ea-c6e7-4eb7-9aea-b198f1f45eee service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state active and task_state None.
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Updating instance_info_cache with network_info: [{"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Releasing lock "refresh_cache-ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Instance network_info: |[{"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-497e4850-a40a-4c31-a23d-9af119dcf378 req-86c1ff8a-df56-469c-ad81-11d25d5a22e2 service nova] Acquired lock "refresh_cache-ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.network.neutron [req-497e4850-a40a-4c31-a23d-9af119dcf378 req-86c1ff8a-df56-469c-ad81-11d25d5a22e2 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Refreshing network info cache for port e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Start _get_guest_xml network_info=[{"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:33:05 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:05 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2077274202',display_name='tempest-TestVolumeSwap-server-2077274202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2077274202',id=8,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6wgz9E12YiGgS+BDu49tgXowLJ5cJiGop8l9sNIpqKOAb5FO2+KRuxyTcuxLaCEp17h4QfV/mBePHdOEfl/A41Jsi1L3Y/8/Mb5yWlTteBCasQbXkHvrHAFP3Xw4/9BQ==',key_name='tempest-keypair-819734159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b15357eef6014b2aa9783fa80a958011',ramdisk_id='',reservation_id='r-0m0ewv6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-896183856',owner_user_name='tempest-TestVolumeSwap-896183856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85e59f5a0e6642d3857838ba05dfca9f',uuid=ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Converting VIF {"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:81:89,bridge_name='br-int',has_traffic_filtering=True,id=e017651b-4710-4d2f-a57a-73401f644453,network=Network(21522351-1b9b-45a4-b246-7f519983e127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape017651b-47') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lazy-loading 'pci_devices' on Instance uuid ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:33:05 user nova-compute[75239]:   <uuid>ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03</uuid>
Nov 13 20:33:05 user nova-compute[75239]:   <name>instance-00000008</name>
Nov 13 20:33:05 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:33:05 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:33:05 user nova-compute[75239]:   <metadata>
Nov 13 20:33:05 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:33:05 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:33:05 user nova-compute[75239]:       <nova:name>tempest-TestVolumeSwap-server-2077274202</nova:name>
Nov 13 20:33:05 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:33:05</nova:creationTime>
Nov 13 20:33:05 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:33:05 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:33:05 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:33:05 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:33:05 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:33:05 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:33:05 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:33:05 user nova-compute[75239]:       <nova:owner>
Nov 13 20:33:05 user nova-compute[75239]:         <nova:user uuid="85e59f5a0e6642d3857838ba05dfca9f">tempest-TestVolumeSwap-896183856-project-member</nova:user>
Nov 13 20:33:05 user nova-compute[75239]:         <nova:project uuid="b15357eef6014b2aa9783fa80a958011">tempest-TestVolumeSwap-896183856</nova:project>
Nov 13 20:33:05 user nova-compute[75239]:       </nova:owner>
Nov 13 20:33:05 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:33:05 user nova-compute[75239]:       <nova:ports>
Nov 13 20:33:05 user nova-compute[75239]:         <nova:port uuid="e017651b-4710-4d2f-a57a-73401f644453">
Nov 13 20:33:05 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:33:05 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:05 user nova-compute[75239]:       </nova:ports>
Nov 13 20:33:05 user nova-compute[75239]:     </nova:instance>
Nov 13 20:33:05 user nova-compute[75239]:   </metadata>
Nov 13 20:33:05 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:33:05 user nova-compute[75239]:     <system>
Nov 13 20:33:05 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:33:05 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:33:05 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:33:05 user nova-compute[75239]:       <entry name="serial">ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03</entry>
Nov 13 20:33:05 user nova-compute[75239]:       <entry name="uuid">ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03</entry>
Nov 13 20:33:05 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:33:05 user nova-compute[75239]:     </system>
Nov 13 20:33:05 user nova-compute[75239]:   </sysinfo>
Nov 13 20:33:05 user nova-compute[75239]:   <os>
Nov 13 20:33:05 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:33:05 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:33:05 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:33:05 user nova-compute[75239]:   </os>
Nov 13 20:33:05 user nova-compute[75239]:   <features>
Nov 13 20:33:05 user nova-compute[75239]:     <acpi/>
Nov 13 20:33:05 user nova-compute[75239]:     <apic/>
Nov 13 20:33:05 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:33:05 user nova-compute[75239]:   </features>
Nov 13 20:33:05 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:33:05 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:33:05 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:33:05 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:33:05 user nova-compute[75239]:   </clock>
Nov 13 20:33:05 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:33:05 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:33:05 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:33:05 user nova-compute[75239]:   </cpu>
Nov 13 20:33:05 user nova-compute[75239]:   <devices>
Nov 13 20:33:05 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:33:05 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:33:05 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk"/>
Nov 13 20:33:05 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:33:05 user nova-compute[75239]:     </disk>
Nov 13 20:33:05 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:05 user nova-compute[75239]:       <mac address="fa:16:3e:e7:81:89"/>
Nov 13 20:33:05 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:05 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:05 user nova-compute[75239]:       <target dev="tape017651b-47"/>
Nov 13 20:33:05 user nova-compute[75239]:     </interface>
Nov 13 20:33:05 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:33:05 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/console.log" append="off"/>
Nov 13 20:33:05 user nova-compute[75239]:     </serial>
Nov 13 20:33:05 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:33:05 user nova-compute[75239]:     <video>
Nov 13 20:33:05 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:05 user nova-compute[75239]:     </video>
Nov 13 20:33:05 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:33:05 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:33:05 user nova-compute[75239]:     </rng>
Nov 13 20:33:05 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:33:05 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:33:05 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:33:05 user nova-compute[75239]:     </memballoon>
Nov 13 20:33:05 user nova-compute[75239]:   </devices>
Nov 13 20:33:05 user nova-compute[75239]: </domain>
Nov 13 20:33:05 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2077274202',display_name='tempest-TestVolumeSwap-server-2077274202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2077274202',id=8,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6wgz9E12YiGgS+BDu49tgXowLJ5cJiGop8l9sNIpqKOAb5FO2+KRuxyTcuxLaCEp17h4QfV/mBePHdOEfl/A41Jsi1L3Y/8/Mb5yWlTteBCasQbXkHvrHAFP3Xw4/9BQ==',key_name='tempest-keypair-819734159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b15357eef6014b2aa9783fa80a958011',ramdisk_id='',reservation_id='r-0m0ewv6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-896183856',owner_user_name='tempest-TestVolumeSwap-896183856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85e59f5a0e6642d3857838ba05dfca9f',uuid=ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Converting VIF {"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:81:89,bridge_name='br-int',has_traffic_filtering=True,id=e017651b-4710-4d2f-a57a-73401f644453,network=Network(21522351-1b9b-45a4-b246-7f519983e127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape017651b-47') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG os_vif [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:81:89,bridge_name='br-int',has_traffic_filtering=True,id=e017651b-4710-4d2f-a57a-73401f644453,network=Network(21522351-1b9b-45a4-b246-7f519983e127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape017651b-47') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31db239c-6a69-5bea-b088-ea64432cf367', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape017651b-47, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape017651b-47, col_values=(('qos', UUID('8d05a514-4cba-47ea-8609-50a975d86511')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape017651b-47, col_values=(('external_ids', {'iface-id': 'e017651b-4710-4d2f-a57a-73401f644453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:81:89', 'vm-uuid': 'ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:05 user nova-compute[75239]: INFO os_vif [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:81:89,bridge_name='br-int',has_traffic_filtering=True,id=e017651b-4710-4d2f-a57a-73401f644453,network=Network(21522351-1b9b-45a4-b246-7f519983e127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape017651b-47')
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:33:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] No VIF found with MAC fa:16:3e:e7:81:89, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:33:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-7ba86af8-732a-4248-827c-bab438304792 req-1775ab22-c35d-4371-8428-d3b5dfe0c967 service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received event network-vif-plugged-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7ba86af8-732a-4248-827c-bab438304792 req-1775ab22-c35d-4371-8428-d3b5dfe0c967 service nova] Acquiring lock "5771f282-957f-4c19-8e50-0d85248a8605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7ba86af8-732a-4248-827c-bab438304792 req-1775ab22-c35d-4371-8428-d3b5dfe0c967 service nova] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7ba86af8-732a-4248-827c-bab438304792 req-1775ab22-c35d-4371-8428-d3b5dfe0c967 service nova] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-7ba86af8-732a-4248-827c-bab438304792 req-1775ab22-c35d-4371-8428-d3b5dfe0c967 service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] No waiting events found dispatching network-vif-plugged-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:06 user nova-compute[75239]: WARNING nova.compute.manager [req-7ba86af8-732a-4248-827c-bab438304792 req-1775ab22-c35d-4371-8428-d3b5dfe0c967 service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received unexpected event network-vif-plugged-0bb0198a-395e-45fb-88cd-53909c6b5521 for instance with vm_state active and task_state None.
Nov 13 20:33:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:07 user nova-compute[75239]: WARNING nova.compute.manager [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state active and task_state None.
Nov 13 20:33:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:07 user nova-compute[75239]: WARNING nova.compute.manager [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state active and task_state None.
Nov 13 20:33:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:07 user nova-compute[75239]: WARNING nova.compute.manager [req-8b9a5a3c-6673-4166-b9d6-284b23f71c2e req-ca5e089c-1651-4bd2-af1d-ed73f2113455 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state active and task_state None.
Nov 13 20:33:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-497e4850-a40a-4c31-a23d-9af119dcf378 req-86c1ff8a-df56-469c-ad81-11d25d5a22e2 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Updated VIF entry in instance network info cache for port e017651b-4710-4d2f-a57a-73401f644453. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-497e4850-a40a-4c31-a23d-9af119dcf378 req-86c1ff8a-df56-469c-ad81-11d25d5a22e2 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Updating instance_info_cache with network_info: [{"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-497e4850-a40a-4c31-a23d-9af119dcf378 req-86c1ff8a-df56-469c-ad81-11d25d5a22e2 service nova] Releasing lock "refresh_cache-ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-74cc2441-6609-4384-8196-fd3b4e030749 req-1e314b26-9cb2-4eb2-b9d3-24844c102230 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received event network-vif-plugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-74cc2441-6609-4384-8196-fd3b4e030749 req-1e314b26-9cb2-4eb2-b9d3-24844c102230 service nova] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-74cc2441-6609-4384-8196-fd3b4e030749 req-1e314b26-9cb2-4eb2-b9d3-24844c102230 service nova] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-74cc2441-6609-4384-8196-fd3b4e030749 req-1e314b26-9cb2-4eb2-b9d3-24844c102230 service nova] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-74cc2441-6609-4384-8196-fd3b4e030749 req-1e314b26-9cb2-4eb2-b9d3-24844c102230 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] No waiting events found dispatching network-vif-plugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:08 user nova-compute[75239]: WARNING nova.compute.manager [req-74cc2441-6609-4384-8196-fd3b4e030749 req-1e314b26-9cb2-4eb2-b9d3-24844c102230 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received unexpected event network-vif-plugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 for instance with vm_state active and task_state None.
Nov 13 20:33:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received event network-vif-plugged-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] Acquiring lock "5771f282-957f-4c19-8e50-0d85248a8605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] No waiting events found dispatching network-vif-plugged-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:08 user nova-compute[75239]: WARNING nova.compute.manager [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received unexpected event network-vif-plugged-0bb0198a-395e-45fb-88cd-53909c6b5521 for instance with vm_state active and task_state None.
Nov 13 20:33:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received event network-vif-plugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] Acquiring lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] No waiting events found dispatching network-vif-plugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:08 user nova-compute[75239]: WARNING nova.compute.manager [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received unexpected event network-vif-plugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e for instance with vm_state active and task_state None.
Nov 13 20:33:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received event network-vif-plugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] Acquiring lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.019s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] No waiting events found dispatching network-vif-plugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:08 user nova-compute[75239]: WARNING nova.compute.manager [req-bff649ab-f87c-49f8-9f3e-051de1185d7b req-27de4cfb-42e0-4bd4-b06f-8348e1eaf70b service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received unexpected event network-vif-plugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e for instance with vm_state active and task_state None.
Nov 13 20:33:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received event network-vif-plugged-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] Acquiring lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] No waiting events found dispatching network-vif-plugged-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:09 user nova-compute[75239]: WARNING nova.compute.manager [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received unexpected event network-vif-plugged-0da27379-6537-4987-ad38-12e5e1d9f277 for instance with vm_state active and task_state None.
Nov 13 20:33:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received event network-vif-plugged-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] Acquiring lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] No waiting events found dispatching network-vif-plugged-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:09 user nova-compute[75239]: WARNING nova.compute.manager [req-3dd042f9-815b-41b2-9ec8-5fe184ae4702 req-b41f7901-961c-4671-9d91-627ea23e7532 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received unexpected event network-vif-plugged-0da27379-6537-4987-ad38-12e5e1d9f277 for instance with vm_state active and task_state None.
Nov 13 20:33:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:33:10 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Instance spawned successfully.
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-dcd53c8f-3a05-4e4a-926d-4287f3919b62 req-91520389-1436-4a12-be65-db5d641e4fbd service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received event network-vif-plugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dcd53c8f-3a05-4e4a-926d-4287f3919b62 req-91520389-1436-4a12-be65-db5d641e4fbd service nova] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dcd53c8f-3a05-4e4a-926d-4287f3919b62 req-91520389-1436-4a12-be65-db5d641e4fbd service nova] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dcd53c8f-3a05-4e4a-926d-4287f3919b62 req-91520389-1436-4a12-be65-db5d641e4fbd service nova] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-dcd53c8f-3a05-4e4a-926d-4287f3919b62 req-91520389-1436-4a12-be65-db5d641e4fbd service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] No waiting events found dispatching network-vif-plugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:10 user nova-compute[75239]: WARNING nova.compute.manager [req-dcd53c8f-3a05-4e4a-926d-4287f3919b62 req-91520389-1436-4a12-be65-db5d641e4fbd service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received unexpected event network-vif-plugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 for instance with vm_state active and task_state None.
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:10 user nova-compute[75239]: INFO nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Took 12.14 seconds to spawn the instance on the hypervisor.
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:33:10 user nova-compute[75239]: INFO nova.compute.manager [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Took 13.50 seconds to build instance.
Nov 13 20:33:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06c88b57-830c-4231-b8ea-ba19e068d0a7 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.815s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:33:10 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Instance spawned successfully.
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:11 user nova-compute[75239]: INFO nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Took 11.31 seconds to spawn the instance on the hypervisor.
Nov 13 20:33:11 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:33:11 user nova-compute[75239]: INFO nova.compute.manager [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Took 13.47 seconds to build instance.
Nov 13 20:33:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b05015fd-d707-4457-839f-ab434dd58b4e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.646s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:33:12 user nova-compute[75239]: INFO nova.compute.claims [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Claim successful on node user
Nov 13 20:33:12 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:33:12 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:33:12 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:33:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG nova.policy [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd95aebf5be2842edbf74038ebd160bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfaaeee24be479fbaac2cd308a81c81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:33:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Creating image(s)
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquiring lock "/opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "/opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "/opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.232s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.354s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk 1073741824" returned: 0 in 0.056s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.418s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.241s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Cannot resize image /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Ensure instance console log exists: /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Successfully created port: 02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-3ce996e1-884f-4f9e-a9c9-19df0083e54e req-d2a099f3-7c15-4d41-9a1c-3a913411b4a1 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received event network-vif-plugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3ce996e1-884f-4f9e-a9c9-19df0083e54e req-d2a099f3-7c15-4d41-9a1c-3a913411b4a1 service nova] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3ce996e1-884f-4f9e-a9c9-19df0083e54e req-d2a099f3-7c15-4d41-9a1c-3a913411b4a1 service nova] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3ce996e1-884f-4f9e-a9c9-19df0083e54e req-d2a099f3-7c15-4d41-9a1c-3a913411b4a1 service nova] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-3ce996e1-884f-4f9e-a9c9-19df0083e54e req-d2a099f3-7c15-4d41-9a1c-3a913411b4a1 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] No waiting events found dispatching network-vif-plugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:14 user nova-compute[75239]: WARNING nova.compute.manager [req-3ce996e1-884f-4f9e-a9c9-19df0083e54e req-d2a099f3-7c15-4d41-9a1c-3a913411b4a1 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received unexpected event network-vif-plugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea for instance with vm_state active and task_state None.
Nov 13 20:33:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Successfully updated port: 02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquiring lock "refresh_cache-01d607cc-47f6-4c80-a7f2-3db54c1ce897" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquired lock "refresh_cache-01d607cc-47f6-4c80-a7f2-3db54c1ce897" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:33:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-b7d9c564-886c-4468-8e72-f6919d5c930a req-1a913f72-17c8-4d3c-bf03-621c4088aa2e service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received event network-changed-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-b7d9c564-886c-4468-8e72-f6919d5c930a req-1a913f72-17c8-4d3c-bf03-621c4088aa2e service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Refreshing instance network info cache due to event network-changed-02e4a5db-35bd-4e10-92de-3a0f4e635ab0. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b7d9c564-886c-4468-8e72-f6919d5c930a req-1a913f72-17c8-4d3c-bf03-621c4088aa2e service nova] Acquiring lock "refresh_cache-01d607cc-47f6-4c80-a7f2-3db54c1ce897" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Updating instance_info_cache with network_info: [{"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Releasing lock "refresh_cache-01d607cc-47f6-4c80-a7f2-3db54c1ce897" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Instance network_info: |[{"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b7d9c564-886c-4468-8e72-f6919d5c930a req-1a913f72-17c8-4d3c-bf03-621c4088aa2e service nova] Acquired lock "refresh_cache-01d607cc-47f6-4c80-a7f2-3db54c1ce897" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.network.neutron [req-b7d9c564-886c-4468-8e72-f6919d5c930a req-1a913f72-17c8-4d3c-bf03-621c4088aa2e service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Refreshing network info cache for port 02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Start _get_guest_xml network_info=[{"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:33:16 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:16 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1048217050',display_name='tempest-VolumesAssistedSnapshotsTest-server-1048217050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1048217050',id=9,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItRmdZhxQB3rCu+RLhzYWCU0a3D8sXGkB0YPOLGwgWMO9lw7FvLjY2t+Q1OHIwMNryX1sdsWjhPBYfW6atHsSo+80pOJt2b7izxfEfKncwxHkGvoZgnzshCzr5YFc9+zQ==',key_name='tempest-keypair-1526853124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfaaeee24be479fbaac2cd308a81c81',ramdisk_id='',reservation_id='r-2i6du10v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-527196103',owner_user_name='tempest-VolumesAssistedSnapshotsTest-527196103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d95aebf5be2842edbf74038ebd160bdd',uuid=01d607cc-47f6-4c80-a7f2-3db54c1ce897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Converting VIF {"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:56:06,bridge_name='br-int',has_traffic_filtering=True,id=02e4a5db-35bd-4e10-92de-3a0f4e635ab0,network=Network(17e1e114-fe89-4bd5-a7fb-539afc6fb06e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e4a5db-35') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lazy-loading 'pci_devices' on Instance uuid 01d607cc-47f6-4c80-a7f2-3db54c1ce897 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:33:16 user nova-compute[75239]:   <uuid>01d607cc-47f6-4c80-a7f2-3db54c1ce897</uuid>
Nov 13 20:33:16 user nova-compute[75239]:   <name>instance-00000009</name>
Nov 13 20:33:16 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:33:16 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:33:16 user nova-compute[75239]:   <metadata>
Nov 13 20:33:16 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:33:16 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:33:16 user nova-compute[75239]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1048217050</nova:name>
Nov 13 20:33:16 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:33:16</nova:creationTime>
Nov 13 20:33:16 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:33:16 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:33:16 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:33:16 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:33:16 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:33:16 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:33:16 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:33:16 user nova-compute[75239]:       <nova:owner>
Nov 13 20:33:16 user nova-compute[75239]:         <nova:user uuid="d95aebf5be2842edbf74038ebd160bdd">tempest-VolumesAssistedSnapshotsTest-527196103-project-member</nova:user>
Nov 13 20:33:16 user nova-compute[75239]:         <nova:project uuid="8dfaaeee24be479fbaac2cd308a81c81">tempest-VolumesAssistedSnapshotsTest-527196103</nova:project>
Nov 13 20:33:16 user nova-compute[75239]:       </nova:owner>
Nov 13 20:33:16 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:33:16 user nova-compute[75239]:       <nova:ports>
Nov 13 20:33:16 user nova-compute[75239]:         <nova:port uuid="02e4a5db-35bd-4e10-92de-3a0f4e635ab0">
Nov 13 20:33:16 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:33:16 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:16 user nova-compute[75239]:       </nova:ports>
Nov 13 20:33:16 user nova-compute[75239]:     </nova:instance>
Nov 13 20:33:16 user nova-compute[75239]:   </metadata>
Nov 13 20:33:16 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:33:16 user nova-compute[75239]:     <system>
Nov 13 20:33:16 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:33:16 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:33:16 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:33:16 user nova-compute[75239]:       <entry name="serial">01d607cc-47f6-4c80-a7f2-3db54c1ce897</entry>
Nov 13 20:33:16 user nova-compute[75239]:       <entry name="uuid">01d607cc-47f6-4c80-a7f2-3db54c1ce897</entry>
Nov 13 20:33:16 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:33:16 user nova-compute[75239]:     </system>
Nov 13 20:33:16 user nova-compute[75239]:   </sysinfo>
Nov 13 20:33:16 user nova-compute[75239]:   <os>
Nov 13 20:33:16 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:33:16 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:33:16 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:33:16 user nova-compute[75239]:   </os>
Nov 13 20:33:16 user nova-compute[75239]:   <features>
Nov 13 20:33:16 user nova-compute[75239]:     <acpi/>
Nov 13 20:33:16 user nova-compute[75239]:     <apic/>
Nov 13 20:33:16 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:33:16 user nova-compute[75239]:   </features>
Nov 13 20:33:16 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:33:16 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:33:16 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:33:16 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:33:16 user nova-compute[75239]:   </clock>
Nov 13 20:33:16 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:33:16 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:33:16 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:33:16 user nova-compute[75239]:   </cpu>
Nov 13 20:33:16 user nova-compute[75239]:   <devices>
Nov 13 20:33:16 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:33:16 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:33:16 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk"/>
Nov 13 20:33:16 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:33:16 user nova-compute[75239]:     </disk>
Nov 13 20:33:16 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:16 user nova-compute[75239]:       <mac address="fa:16:3e:99:56:06"/>
Nov 13 20:33:16 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:16 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:16 user nova-compute[75239]:       <target dev="tap02e4a5db-35"/>
Nov 13 20:33:16 user nova-compute[75239]:     </interface>
Nov 13 20:33:16 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:33:16 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/console.log" append="off"/>
Nov 13 20:33:16 user nova-compute[75239]:     </serial>
Nov 13 20:33:16 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:33:16 user nova-compute[75239]:     <video>
Nov 13 20:33:16 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:16 user nova-compute[75239]:     </video>
Nov 13 20:33:16 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:33:16 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:33:16 user nova-compute[75239]:     </rng>
Nov 13 20:33:16 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:33:16 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:33:16 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:33:16 user nova-compute[75239]:     </memballoon>
Nov 13 20:33:16 user nova-compute[75239]:   </devices>
Nov 13 20:33:16 user nova-compute[75239]: </domain>
Nov 13 20:33:16 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1048217050',display_name='tempest-VolumesAssistedSnapshotsTest-server-1048217050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1048217050',id=9,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItRmdZhxQB3rCu+RLhzYWCU0a3D8sXGkB0YPOLGwgWMO9lw7FvLjY2t+Q1OHIwMNryX1sdsWjhPBYfW6atHsSo+80pOJt2b7izxfEfKncwxHkGvoZgnzshCzr5YFc9+zQ==',key_name='tempest-keypair-1526853124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfaaeee24be479fbaac2cd308a81c81',ramdisk_id='',reservation_id='r-2i6du10v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-527196103',owner_user_name='tempest-VolumesAssistedSnapshotsTest-527196103-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d95aebf5be2842edbf74038ebd160bdd',uuid=01d607cc-47f6-4c80-a7f2-3db54c1ce897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Converting VIF {"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:56:06,bridge_name='br-int',has_traffic_filtering=True,id=02e4a5db-35bd-4e10-92de-3a0f4e635ab0,network=Network(17e1e114-fe89-4bd5-a7fb-539afc6fb06e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e4a5db-35') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG os_vif [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:56:06,bridge_name='br-int',has_traffic_filtering=True,id=02e4a5db-35bd-4e10-92de-3a0f4e635ab0,network=Network(17e1e114-fe89-4bd5-a7fb-539afc6fb06e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e4a5db-35') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ae0c9e2-55b3-5ab9-a570-f6cb504102a2', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02e4a5db-35, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02e4a5db-35, col_values=(('qos', UUID('bc4af8e6-94eb-4479-9412-76d7ff78c90c')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02e4a5db-35, col_values=(('external_ids', {'iface-id': '02e4a5db-35bd-4e10-92de-3a0f4e635ab0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:56:06', 'vm-uuid': '01d607cc-47f6-4c80-a7f2-3db54c1ce897'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:16 user nova-compute[75239]: INFO os_vif [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:56:06,bridge_name='br-int',has_traffic_filtering=True,id=02e4a5db-35bd-4e10-92de-3a0f4e635ab0,network=Network(17e1e114-fe89-4bd5-a7fb-539afc6fb06e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e4a5db-35')
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] No VIF found with MAC fa:16:3e:99:56:06, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received event network-vif-plugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] No waiting events found dispatching network-vif-plugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:16 user nova-compute[75239]: WARNING nova.compute.manager [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received unexpected event network-vif-plugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea for instance with vm_state active and task_state None.
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received event network-vif-plugged-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] No waiting events found dispatching network-vif-plugged-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:16 user nova-compute[75239]: WARNING nova.compute.manager [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received unexpected event network-vif-plugged-e017651b-4710-4d2f-a57a-73401f644453 for instance with vm_state active and task_state None.
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received event network-vif-plugged-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] No waiting events found dispatching network-vif-plugged-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:16 user nova-compute[75239]: WARNING nova.compute.manager [req-6b6aa945-8d70-41a9-b3fc-61b2533de9af req-20b85989-e3ce-4a21-baee-2918622ecd3f service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received unexpected event network-vif-plugged-e017651b-4710-4d2f-a57a-73401f644453 for instance with vm_state active and task_state None.
Nov 13 20:33:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:17 user nova-compute[75239]: DEBUG nova.network.neutron [req-b7d9c564-886c-4468-8e72-f6919d5c930a req-1a913f72-17c8-4d3c-bf03-621c4088aa2e service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Updated VIF entry in instance network info cache for port 02e4a5db-35bd-4e10-92de-3a0f4e635ab0. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:33:17 user nova-compute[75239]: DEBUG nova.network.neutron [req-b7d9c564-886c-4468-8e72-f6919d5c930a req-1a913f72-17c8-4d3c-bf03-621c4088aa2e service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Updating instance_info_cache with network_info: [{"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b7d9c564-886c-4468-8e72-f6919d5c930a req-1a913f72-17c8-4d3c-bf03-621c4088aa2e service nova] Releasing lock "refresh_cache-01d607cc-47f6-4c80-a7f2-3db54c1ce897" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquiring lock "9373b4cc-900f-4657-8d3c-b9b87746b73b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:33:18 user nova-compute[75239]: INFO nova.compute.claims [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Claim successful on node user
Nov 13 20:33:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.880s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:33:19 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:33:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG nova.policy [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01fcde5e48124323b63299c2d0283099', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bb758dca03e46169ddab689f3b297a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:33:19 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Creating image(s)
Nov 13 20:33:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquiring lock "/opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "/opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "/opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.227s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.329s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk 1073741824" returned: 0 in 0.139s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.492s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Successfully created port: 907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.311s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Cannot resize image /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Ensure instance console log exists: /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:33:21 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Instance spawned successfully.
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 20:33:21 user nova-compute[75239]: INFO nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Took 8.01 seconds to spawn the instance on the hypervisor.
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:21 user nova-compute[75239]: INFO nova.compute.manager [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Took 9.36 seconds to build instance.
Nov 13 20:33:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a3fed30-fa85-49fa-86c6-4236adc1fd48 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.499s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Successfully updated port: 907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquiring lock "refresh_cache-9373b4cc-900f-4657-8d3c-b9b87746b73b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquired lock "refresh_cache-9373b4cc-900f-4657-8d3c-b9b87746b73b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-a3301400-6d4d-4edf-b49e-f3330a21eab1 req-50de6a97-afe9-42aa-909a-1638ca0da209 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received event network-changed-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-a3301400-6d4d-4edf-b49e-f3330a21eab1 req-50de6a97-afe9-42aa-909a-1638ca0da209 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Refreshing instance network info cache due to event network-changed-907f2d51-17ac-4fae-ad50-bb5601668a83. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a3301400-6d4d-4edf-b49e-f3330a21eab1 req-50de6a97-afe9-42aa-909a-1638ca0da209 service nova] Acquiring lock "refresh_cache-9373b4cc-900f-4657-8d3c-b9b87746b73b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Updating instance_info_cache with network_info: [{"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Releasing lock "refresh_cache-9373b4cc-900f-4657-8d3c-b9b87746b73b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Instance network_info: |[{"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a3301400-6d4d-4edf-b49e-f3330a21eab1 req-50de6a97-afe9-42aa-909a-1638ca0da209 service nova] Acquired lock "refresh_cache-9373b4cc-900f-4657-8d3c-b9b87746b73b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.network.neutron [req-a3301400-6d4d-4edf-b49e-f3330a21eab1 req-50de6a97-afe9-42aa-909a-1638ca0da209 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Refreshing network info cache for port 907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Start _get_guest_xml network_info=[{"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:33:22 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:22 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-418576512',display_name='tempest-VolumesActionsTest-instance-418576512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-418576512',id=10,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb758dca03e46169ddab689f3b297a9',ramdisk_id='',reservation_id='r-x2drnvxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-133738285',owner_user_name='tempest-VolumesActionsTest-133738285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:19Z,user_data=None,user_id='01fcde5e48124323b63299c2d0283099',uuid=9373b4cc-900f-4657-8d3c-b9b87746b73b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Converting VIF {"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:db:67,bridge_name='br-int',has_traffic_filtering=True,id=907f2d51-17ac-4fae-ad50-bb5601668a83,network=Network(c524e351-a8ca-4e21-8efe-fc4e951da538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907f2d51-17') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.objects.instance [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lazy-loading 'pci_devices' on Instance uuid 9373b4cc-900f-4657-8d3c-b9b87746b73b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:33:22 user nova-compute[75239]:   <uuid>9373b4cc-900f-4657-8d3c-b9b87746b73b</uuid>
Nov 13 20:33:22 user nova-compute[75239]:   <name>instance-0000000a</name>
Nov 13 20:33:22 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:33:22 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:33:22 user nova-compute[75239]:   <metadata>
Nov 13 20:33:22 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:33:22 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:33:22 user nova-compute[75239]:       <nova:name>tempest-VolumesActionsTest-instance-418576512</nova:name>
Nov 13 20:33:22 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:33:22</nova:creationTime>
Nov 13 20:33:22 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:33:22 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:33:22 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:33:22 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:33:22 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:33:22 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:33:22 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:33:22 user nova-compute[75239]:       <nova:owner>
Nov 13 20:33:22 user nova-compute[75239]:         <nova:user uuid="01fcde5e48124323b63299c2d0283099">tempest-VolumesActionsTest-133738285-project-member</nova:user>
Nov 13 20:33:22 user nova-compute[75239]:         <nova:project uuid="5bb758dca03e46169ddab689f3b297a9">tempest-VolumesActionsTest-133738285</nova:project>
Nov 13 20:33:22 user nova-compute[75239]:       </nova:owner>
Nov 13 20:33:22 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:33:22 user nova-compute[75239]:       <nova:ports>
Nov 13 20:33:22 user nova-compute[75239]:         <nova:port uuid="907f2d51-17ac-4fae-ad50-bb5601668a83">
Nov 13 20:33:22 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 20:33:22 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:22 user nova-compute[75239]:       </nova:ports>
Nov 13 20:33:22 user nova-compute[75239]:     </nova:instance>
Nov 13 20:33:22 user nova-compute[75239]:   </metadata>
Nov 13 20:33:22 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:33:22 user nova-compute[75239]:     <system>
Nov 13 20:33:22 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:33:22 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:33:22 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:33:22 user nova-compute[75239]:       <entry name="serial">9373b4cc-900f-4657-8d3c-b9b87746b73b</entry>
Nov 13 20:33:22 user nova-compute[75239]:       <entry name="uuid">9373b4cc-900f-4657-8d3c-b9b87746b73b</entry>
Nov 13 20:33:22 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:33:22 user nova-compute[75239]:     </system>
Nov 13 20:33:22 user nova-compute[75239]:   </sysinfo>
Nov 13 20:33:22 user nova-compute[75239]:   <os>
Nov 13 20:33:22 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:33:22 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:33:22 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:33:22 user nova-compute[75239]:   </os>
Nov 13 20:33:22 user nova-compute[75239]:   <features>
Nov 13 20:33:22 user nova-compute[75239]:     <acpi/>
Nov 13 20:33:22 user nova-compute[75239]:     <apic/>
Nov 13 20:33:22 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:33:22 user nova-compute[75239]:   </features>
Nov 13 20:33:22 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:33:22 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:33:22 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:33:22 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:33:22 user nova-compute[75239]:   </clock>
Nov 13 20:33:22 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:33:22 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:33:22 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:33:22 user nova-compute[75239]:   </cpu>
Nov 13 20:33:22 user nova-compute[75239]:   <devices>
Nov 13 20:33:22 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:33:22 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:33:22 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk"/>
Nov 13 20:33:22 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:33:22 user nova-compute[75239]:     </disk>
Nov 13 20:33:22 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:22 user nova-compute[75239]:       <mac address="fa:16:3e:b1:db:67"/>
Nov 13 20:33:22 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:22 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:22 user nova-compute[75239]:       <target dev="tap907f2d51-17"/>
Nov 13 20:33:22 user nova-compute[75239]:     </interface>
Nov 13 20:33:22 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:33:22 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/console.log" append="off"/>
Nov 13 20:33:22 user nova-compute[75239]:     </serial>
Nov 13 20:33:22 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:33:22 user nova-compute[75239]:     <video>
Nov 13 20:33:22 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:22 user nova-compute[75239]:     </video>
Nov 13 20:33:22 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:33:22 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:33:22 user nova-compute[75239]:     </rng>
Nov 13 20:33:22 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:33:22 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:33:22 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:33:22 user nova-compute[75239]:     </memballoon>
Nov 13 20:33:22 user nova-compute[75239]:   </devices>
Nov 13 20:33:22 user nova-compute[75239]: </domain>
Nov 13 20:33:22 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-418576512',display_name='tempest-VolumesActionsTest-instance-418576512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-418576512',id=10,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5bb758dca03e46169ddab689f3b297a9',ramdisk_id='',reservation_id='r-x2drnvxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-133738285',owner_user_name='tempest-VolumesActionsTest-133738285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:19Z,user_data=None,user_id='01fcde5e48124323b63299c2d0283099',uuid=9373b4cc-900f-4657-8d3c-b9b87746b73b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Converting VIF {"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:db:67,bridge_name='br-int',has_traffic_filtering=True,id=907f2d51-17ac-4fae-ad50-bb5601668a83,network=Network(c524e351-a8ca-4e21-8efe-fc4e951da538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907f2d51-17') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG os_vif [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:db:67,bridge_name='br-int',has_traffic_filtering=True,id=907f2d51-17ac-4fae-ad50-bb5601668a83,network=Network(c524e351-a8ca-4e21-8efe-fc4e951da538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907f2d51-17') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a170c8b-8b01-5025-8d62-1bd0a5e68d9c', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap907f2d51-17, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap907f2d51-17, col_values=(('qos', UUID('f669bd44-5bd1-42d2-aadb-698a88950d66')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap907f2d51-17, col_values=(('external_ids', {'iface-id': '907f2d51-17ac-4fae-ad50-bb5601668a83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:db:67', 'vm-uuid': '9373b4cc-900f-4657-8d3c-b9b87746b73b'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:22 user nova-compute[75239]: INFO os_vif [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:db:67,bridge_name='br-int',has_traffic_filtering=True,id=907f2d51-17ac-4fae-ad50-bb5601668a83,network=Network(c524e351-a8ca-4e21-8efe-fc4e951da538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907f2d51-17')
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:33:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] No VIF found with MAC fa:16:3e:b1:db:67, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:33:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-a3301400-6d4d-4edf-b49e-f3330a21eab1 req-50de6a97-afe9-42aa-909a-1638ca0da209 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Updated VIF entry in instance network info cache for port 907f2d51-17ac-4fae-ad50-bb5601668a83. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:33:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-a3301400-6d4d-4edf-b49e-f3330a21eab1 req-50de6a97-afe9-42aa-909a-1638ca0da209 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Updating instance_info_cache with network_info: [{"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a3301400-6d4d-4edf-b49e-f3330a21eab1 req-50de6a97-afe9-42aa-909a-1638ca0da209 service nova] Releasing lock "refresh_cache-9373b4cc-900f-4657-8d3c-b9b87746b73b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:23 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:23 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-c8156041-6004-49dc-866f-84521b88b4e5 req-07f76949-533f-4545-ab62-a8367f6eb585 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received event network-vif-plugged-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c8156041-6004-49dc-866f-84521b88b4e5 req-07f76949-533f-4545-ab62-a8367f6eb585 service nova] Acquiring lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c8156041-6004-49dc-866f-84521b88b4e5 req-07f76949-533f-4545-ab62-a8367f6eb585 service nova] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c8156041-6004-49dc-866f-84521b88b4e5 req-07f76949-533f-4545-ab62-a8367f6eb585 service nova] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-c8156041-6004-49dc-866f-84521b88b4e5 req-07f76949-533f-4545-ab62-a8367f6eb585 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] No waiting events found dispatching network-vif-plugged-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:24 user nova-compute[75239]: WARNING nova.compute.manager [req-c8156041-6004-49dc-866f-84521b88b4e5 req-07f76949-533f-4545-ab62-a8367f6eb585 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received unexpected event network-vif-plugged-907f2d51-17ac-4fae-ad50-bb5601668a83 for instance with vm_state building and task_state spawning.
Nov 13 20:33:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Instance spawned successfully.
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-bd53063d-ed79-4560-9067-0d434aae186d req-d3608159-c303-4cc8-a5cc-c284511582e6 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received event network-vif-plugged-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bd53063d-ed79-4560-9067-0d434aae186d req-d3608159-c303-4cc8-a5cc-c284511582e6 service nova] Acquiring lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bd53063d-ed79-4560-9067-0d434aae186d req-d3608159-c303-4cc8-a5cc-c284511582e6 service nova] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bd53063d-ed79-4560-9067-0d434aae186d req-d3608159-c303-4cc8-a5cc-c284511582e6 service nova] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-bd53063d-ed79-4560-9067-0d434aae186d req-d3608159-c303-4cc8-a5cc-c284511582e6 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] No waiting events found dispatching network-vif-plugged-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:26 user nova-compute[75239]: WARNING nova.compute.manager [req-bd53063d-ed79-4560-9067-0d434aae186d req-d3608159-c303-4cc8-a5cc-c284511582e6 service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received unexpected event network-vif-plugged-907f2d51-17ac-4fae-ad50-bb5601668a83 for instance with vm_state building and task_state spawning.
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:27 user nova-compute[75239]: INFO nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Took 7.57 seconds to spawn the instance on the hypervisor.
Nov 13 20:33:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:27 user nova-compute[75239]: INFO nova.compute.manager [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Took 9.18 seconds to build instance.
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fb0ccfdd-f900-4d53-9d08-1188ef78eee3 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.393s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-38175917-5105-4434-abc7-c1b6ea5c054b req-4c0900ed-3f86-404d-bc2c-d04026838e88 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received event network-vif-plugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-38175917-5105-4434-abc7-c1b6ea5c054b req-4c0900ed-3f86-404d-bc2c-d04026838e88 service nova] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-38175917-5105-4434-abc7-c1b6ea5c054b req-4c0900ed-3f86-404d-bc2c-d04026838e88 service nova] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-38175917-5105-4434-abc7-c1b6ea5c054b req-4c0900ed-3f86-404d-bc2c-d04026838e88 service nova] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-38175917-5105-4434-abc7-c1b6ea5c054b req-4c0900ed-3f86-404d-bc2c-d04026838e88 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] No waiting events found dispatching network-vif-plugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:27 user nova-compute[75239]: WARNING nova.compute.manager [req-38175917-5105-4434-abc7-c1b6ea5c054b req-4c0900ed-3f86-404d-bc2c-d04026838e88 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received unexpected event network-vif-plugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 for instance with vm_state active and task_state None.
Nov 13 20:33:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-7170fd9d-ba5a-4734-aa25-f5f536294cc8 req-bc5de794-6c4a-499e-a927-b96ad48fb661 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received event network-vif-plugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7170fd9d-ba5a-4734-aa25-f5f536294cc8 req-bc5de794-6c4a-499e-a927-b96ad48fb661 service nova] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7170fd9d-ba5a-4734-aa25-f5f536294cc8 req-bc5de794-6c4a-499e-a927-b96ad48fb661 service nova] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7170fd9d-ba5a-4734-aa25-f5f536294cc8 req-bc5de794-6c4a-499e-a927-b96ad48fb661 service nova] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-7170fd9d-ba5a-4734-aa25-f5f536294cc8 req-bc5de794-6c4a-499e-a927-b96ad48fb661 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] No waiting events found dispatching network-vif-plugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:29 user nova-compute[75239]: WARNING nova.compute.manager [req-7170fd9d-ba5a-4734-aa25-f5f536294cc8 req-bc5de794-6c4a-499e-a927-b96ad48fb661 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received unexpected event network-vif-plugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 for instance with vm_state active and task_state None.
Nov 13 20:33:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:33:29 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:29 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7327MB free_disk=25.475444793701172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 5771f282-957f-4c19-8e50-0d85248a8605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d67fcb6b-fb37-4d04-8dab-d74370f76981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ae8531d9-3930-4373-91b2-628d850e8ba7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4577b5eb-6acf-4616-931b-28b5ef72d739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 9373b4cc-900f-4657-8d3c-b9b87746b73b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 927720cf-b009-4f9d-8e54-1b5cd3788e99 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.961s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.619s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:33:30 user nova-compute[75239]: INFO nova.compute.claims [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Claim successful on node user
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:33:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:33:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:33:31 user nova-compute[75239]: INFO nova.virt.block_device [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Booting with volume fb9b6eaf-a319-41f0-832c-45b27222a389 at /dev/vda
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.policy [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60384062463c4ab19832ee523767f4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9ba6493d9174244bc27bacaec40b580', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:33:31 user nova-compute[75239]: DEBUG os_brick.utils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:33:31 user nova-compute[75239]: INFO oslo.privsep.daemon [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpmwg75jk8/privsep.sock']
Nov 13 20:33:31 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:33:31 user sudo[86388]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpmwg75jk8/privsep.sock
Nov 13 20:33:31 user sudo[86388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 20:33:31 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Skipping network cache update for instance because it is Building. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 20:33:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-5771f282-957f-4c19-8e50-0d85248a8605" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-5771f282-957f-4c19-8e50-0d85248a8605" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:32 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:33:32 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 5771f282-957f-4c19-8e50-0d85248a8605 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:33:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:32 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully created port: 5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:33:32 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Updating instance_info_cache with network_info: [{"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-5771f282-957f-4c19-8e50-0d85248a8605" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully created port: 80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:33:33 user sudo[86388]: pam_unix(sudo:session): session closed for user root
Nov 13 20:33:33 user nova-compute[75239]: INFO oslo.privsep.daemon [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Spawned new privsep daemon via rootwrap
Nov 13 20:33:33 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 20:33:33 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 20:33:33 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 13 20:33:33 user nova-compute[75239]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86402
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a27205a-1514-4e0d-b91b-7ca570fd1d74]: (2,) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ee75ed-51e9-40e7-a8d9-57b039e3f215]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:33 user nova-compute[75239]: WARNING os_brick.initiator.connectors.nvmeof [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa16f42-d6d4-49af-b71e-82805092aab0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[537a74ed-abb2-4c2a-83c8-f2edf40f7bc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73cc0af-33f0-4d85-8a32-727d8b0fd847]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:33:33 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:33:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bc23d6-4688-47d5-b633-5e387bf328ad]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG os_brick.utils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] <== get_connector_properties: return (2183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:33:33 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating existing volume attachment record: 73c6570b-88c4-4b29-bd47-7eedf6cfa118 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:33:34 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully created port: 6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:33:34 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully created port: 416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:33:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully created port: 29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully updated port: 5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-dd244561-ef36-4051-be94-e094a681d604 req-a94980df-22a2-4018-9239-af07a618b588 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-changed-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-dd244561-ef36-4051-be94-e094a681d604 req-a94980df-22a2-4018-9239-af07a618b588 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing instance network info cache due to event network-changed-5b3076cd-3c9c-4261-9361-c18fb53f1a38. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dd244561-ef36-4051-be94-e094a681d604 req-a94980df-22a2-4018-9239-af07a618b588 service nova] Acquiring lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dd244561-ef36-4051-be94-e094a681d604 req-a94980df-22a2-4018-9239-af07a618b588 service nova] Acquired lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG nova.network.neutron [req-dd244561-ef36-4051-be94-e094a681d604 req-a94980df-22a2-4018-9239-af07a618b588 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing network info cache for port 5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG nova.network.neutron [req-dd244561-ef36-4051-be94-e094a681d604 req-a94980df-22a2-4018-9239-af07a618b588 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG nova.network.neutron [req-dd244561-ef36-4051-be94-e094a681d604 req-a94980df-22a2-4018-9239-af07a618b588 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dd244561-ef36-4051-be94-e094a681d604 req-a94980df-22a2-4018-9239-af07a618b588 service nova] Releasing lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully updated port: 96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully updated port: 74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-changed-96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing instance network info cache due to event network-changed-96cbdec2-4706-42b7-aaa4-5eeabd622a4e. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] Acquiring lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] Acquired lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing network info cache for port 96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully updated port: 80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:38 user nova-compute[75239]: INFO nova.virt.block_device [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Booting with volume b99047d9-b258-4356-976e-d5ebd844aecf at /dev/vdb
Nov 13 20:33:38 user nova-compute[75239]: DEBUG os_brick.utils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef87a790-233e-44c3-b5a5-09aae63978ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e879269-9a5a-4689-a8ea-d46c69b74ec2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb78428-b355-4fa7-8d42-4d5460c05bac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bac086-4f8b-4300-b256-0a541402e96d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] Releasing lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-changed-74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing instance network info cache due to event network-changed-74b0eca2-dc64-4486-8194-83f22572f6af. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] Acquiring lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] Acquired lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing network info cache for port 74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:33:38 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:33:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f386d07d-aea0-4a08-b636-9f147dc336ce]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG os_brick.utils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating existing volume attachment record: c4ae9d90-50d0-4dab-80ca-6ac94843e541 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:33:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:39 user nova-compute[75239]: DEBUG nova.network.neutron [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4a4e5326-4f72-4301-9078-0b8193b8ef1f req-b2aa9571-0509-4164-a746-05776249b091 service nova] Releasing lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully updated port: 6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully updated port: 416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-changed-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing instance network info cache due to event network-changed-80ebe795-140c-43d3-a071-f9b0ce708bd8. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] Acquiring lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] Acquired lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.network.neutron [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing network info cache for port 80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.network.neutron [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.network.neutron [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] Releasing lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-changed-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing instance network info cache due to event network-changed-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] Acquiring lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] Acquired lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.network.neutron [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing network info cache for port 6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.network.neutron [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Successfully updated port: 29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.network.neutron [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] Releasing lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-changed-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing instance network info cache due to event network-changed-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] Acquiring lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] Acquired lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:40 user nova-compute[75239]: DEBUG nova.network.neutron [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing network info cache for port 416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:41 user nova-compute[75239]: DEBUG nova.network.neutron [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:41 user nova-compute[75239]: DEBUG nova.network.neutron [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30615236-d780-4ff5-a8b3-89b118c56fdd req-83a5edf8-9f2c-4b3c-931a-72ffb8d97ef4 service nova] Releasing lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquired lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:33:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:33:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-0d936735-f41b-4f87-95e2-9a07d8cb45a1 req-4f5df9b3-bcff-4b1d-a661-3f67e7564bd2 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-changed-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-0d936735-f41b-4f87-95e2-9a07d8cb45a1 req-4f5df9b3-bcff-4b1d-a661-3f67e7564bd2 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing instance network info cache due to event network-changed-29916a60-1b87-4742-abee-1048131017b8. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:33:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0d936735-f41b-4f87-95e2-9a07d8cb45a1 req-4f5df9b3-bcff-4b1d-a661-3f67e7564bd2 service nova] Acquiring lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:33:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:43 user nova-compute[75239]: INFO nova.virt.block_device [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Booting with volume 47c5c4cd-42e5-481c-83d6-fc9641554b80 at /dev/vdc
Nov 13 20:33:43 user nova-compute[75239]: DEBUG os_brick.utils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[52439095-4ac4-4c92-9e68-5465c4a43fe3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG nova.network.neutron [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [{"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a29a0d-94f7-41d6-92e4-b095a3f393ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Releasing lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance network_info: |[{"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1403a48-3d68-4559-9f95-fac660af1445]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0d936735-f41b-4f87-95e2-9a07d8cb45a1 req-4f5df9b3-bcff-4b1d-a661-3f67e7564bd2 service nova] Acquired lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG nova.network.neutron [req-0d936735-f41b-4f87-95e2-9a07d8cb45a1 req-4f5df9b3-bcff-4b1d-a661-3f67e7564bd2 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing network info cache for port 29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5a7591-6ede-4b82-b87f-00aa3d0d445e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:33:43 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a11a05d-bd40-410e-9199-b5092ff4d822]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG os_brick.utils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating existing volume attachment record: de0d5137-1f27-4d80-86f7-43c6247b50e9 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG nova.network.neutron [req-0d936735-f41b-4f87-95e2-9a07d8cb45a1 req-4f5df9b3-bcff-4b1d-a661-3f67e7564bd2 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updated VIF entry in instance network info cache for port 29916a60-1b87-4742-abee-1048131017b8. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG nova.network.neutron [req-0d936735-f41b-4f87-95e2-9a07d8cb45a1 req-4f5df9b3-bcff-4b1d-a661-3f67e7564bd2 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [{"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:33:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0d936735-f41b-4f87-95e2-9a07d8cb45a1 req-4f5df9b3-bcff-4b1d-a661-3f67e7564bd2 service nova] Releasing lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:33:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:33:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Creating image(s)
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Ensure instance console log exists: /opt/stack/data/nova/instances/927720cf-b009-4f9d-8e54-1b5cd3788e99/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Start _get_guest_xml network_info=[{"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '73c6570b-88c4-4b29-bd47-7eedf6cfa118', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elnxJwKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '927720cf-b009-4f9d-8e54-1b5cd3788e99', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb9b6eaf-a319-41f0-832c-45b27222a389', 'serial': 'fb9b6eaf-a319-41f0-832c-45b27222a389'}, 'guest_format': None, 'volume_type': None}, {'attachment_id': 'c4ae9d90-50d0-4dab-80ca-6ac94843e541', 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joWGnYRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '927720cf-b009-4f9d-8e54-1b5cd3788e99', 'attached_at': '', 'detached_at': '', 'volume_id': 'b99047d9-b258-4356-976e-d5ebd844aecf', 'serial': 'b99047d9-b258-4356-976e-d5ebd844aecf'}, 'guest_format': None, 'volume_type': None}, {'attachment_id': 'de0d5137-1f27-4d80-86f7-43c6247b50e9', 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpYQxAiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '927720cf-b009-4f9d-8e54-1b5cd3788e99', 'attached_at': '', 'detached_at': '', 'volume_id': '47c5c4cd-42e5-481c-83d6-fc9641554b80', 'serial': '47c5c4cd-42e5-481c-83d6-fc9641554b80'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:33:48 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:48 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connector [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Factory for ISCSI on None {{(pid=75239) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elnxJwKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:33:48 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:33:48 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:33:48 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7e15be-5481-4ea6-ac96-9d31900d2418]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:33:48 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a450c7a3-5354-4568-aad5-076425163086]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389] added
Nov 13 20:33:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[306a9f85-c6a4-493f-abf3-ea3bde58fef2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f8e780-a874-444e-beb4-0e8b519d833e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v elnxJwKF {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v elnxJwKF" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3873920f-f33c-4d42-a274-77adb2371237]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'elnxJwKF'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a19b1f-6a9e-489a-bed7-64988136c78d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1854af24-a24d-41e4-b9b4-f022022cc2e7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:33:48 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:33:48 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:33:48 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 20:33:48 user nova-compute[75239]: 
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b45f289-5b33-45cf-a65c-37ef35db591c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389, portal: 172.16.0.220,3260]
Nov 13 20:33:48 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389, portal: 172.16.0.220,3260] successful.
Nov 13 20:33:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67eea12-56b0-4c97-b5ab-8255d241c3f6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b459af-f3dc-4372-b73f-14cdb9f03262]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28d93e-cea9-4ee5-8ad1-16ed3c5179cf]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:33:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elnxJwKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:33:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:33:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23564356364356438', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:33:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564356364356438', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joWGnYRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:33:50 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:33:50 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:33:50 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2ec121-b355-4f01-a166-a87f46fe4a39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:33:50 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[802ff27b-6efa-4ed8-a530-94268b25840e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf] added
Nov 13 20:33:50 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa837f2-b83d-4b83-830d-96344cfa07b1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[509f8789-1c7d-4bf5-b64a-d2793e782677]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joWGnYRd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v joWGnYRd" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35a7c9a-0ac4-413a-8c99-ae0aa8169a22]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'joWGnYRd'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc4cee-d16d-4bfc-957a-6ecd13649ee6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c9977-be09-4ee0-8139-44b8e6869b1d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:50 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:50 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b75af5a-0711-439e-9430-9cf3bd660b38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf, portal: 172.16.0.220,3260]
Nov 13 20:33:50 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf, portal: 172.16.0.220,3260] successful.
Nov 13 20:33:50 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[42632fc5-b265-43c0-a34f-18d98327ef68]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60afc685-f220-46ea-85d4-c2046900ce43]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:50 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:33:50 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:50 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:33:50 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[717e076c-cb67-4376-9b52-c58fb495fcc5]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:33:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joWGnYRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23330623162643264', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330623162643264', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpYQxAiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:33:51 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:33:51 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:33:51 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[309e6ce1-3a32-4e0d-8937-8934e04aca5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:33:51 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ea40e6-7e95-487b-b1b6-057078d55463]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80] added
Nov 13 20:33:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c195b09c-4e9c-4279-b021-1c52bbbbe309]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b104d3c-1770-438a-bac2-5b599b00f52f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpYQxAiV {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OpYQxAiV" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3609530-b74d-4301-8315-e4b2bde1ac26]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OpYQxAiV'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc895d92-c2d6-44a2-8f7c-c1915f2387a3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b14c99f-1dd5-4a20-92f6-2f2fa45a09fb]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:51 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:33:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:51 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:33:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05b17b3-e4e4-4de7-b5d9-05585487f6cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80, portal: 172.16.0.220,3260]
Nov 13 20:33:51 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80, portal: 172.16.0.220,3260] successful.
Nov 13 20:33:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d447f10a-9713-4faf-829e-45c1f4cfd010]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb747d29-57e9-449b-8937-dee64c815376]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:51 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:33:51 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:33:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:33:51 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:33:51 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:33:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e969fc-c76d-44ec-a04c-3a498c23807e]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:33:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpYQxAiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23962333130366430', 'path': '/dev/sdd'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962333130366430', 'path': '/dev/sdd'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:7c:4f,bridge_name='br-int',has_traffic_filtering=True,id=5b3076cd-3c9c-4261-9361-c18fb53f1a38,network=Network(000df844-a6fb-4c88-b39f-2adbfe4693af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3076cd-3c') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:af,bridge_name='br-int',has_traffic_filtering=True,id=96cbdec2-4706-42b7-aaa4-5eeabd622a4e,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96cbdec2-47') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=74b0eca2-dc64-4486-8194-83f22572f6af,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74b0eca2-dc') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:64,bridge_name='br-int',has_traffic_filtering=True,id=80ebe795-140c-43d3-a071-f9b0ce708bd8,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ebe795-14') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:68:49,bridge_name='br-int',has_traffic_filtering=True,id=6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fcd02c3-9f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:61,bridge_name='br-int',has_traffic_filtering=True,id=416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe38c-01') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:8b,bridge_name='br-int',has_traffic_filtering=True,id=29916a60-1b87-4742-abee-1048131017b8,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29916a60-1b') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.objects.instance [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lazy-loading 'pci_devices' on Instance uuid 927720cf-b009-4f9d-8e54-1b5cd3788e99 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:33:52 user nova-compute[75239]:   <uuid>927720cf-b009-4f9d-8e54-1b5cd3788e99</uuid>
Nov 13 20:33:52 user nova-compute[75239]:   <name>instance-0000000b</name>
Nov 13 20:33:52 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:33:52 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:33:52 user nova-compute[75239]:   <metadata>
Nov 13 20:33:52 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:33:52 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:33:52 user nova-compute[75239]:       <nova:name>tempest-device-tagging-server-2123973480</nova:name>
Nov 13 20:33:52 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:33:48</nova:creationTime>
Nov 13 20:33:52 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:33:52 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:33:52 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:33:52 user nova-compute[75239]:       <nova:owner>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:user uuid="60384062463c4ab19832ee523767f4e8">tempest-TaggedBootDevicesTest-1300668237-project-member</nova:user>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:project uuid="d9ba6493d9174244bc27bacaec40b580">tempest-TaggedBootDevicesTest-1300668237</nova:project>
Nov 13 20:33:52 user nova-compute[75239]:       </nova:owner>
Nov 13 20:33:52 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:33:52 user nova-compute[75239]:       <nova:ports>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:port uuid="5b3076cd-3c9c-4261-9361-c18fb53f1a38">
Nov 13 20:33:52 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 20:33:52 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:port uuid="96cbdec2-4706-42b7-aaa4-5eeabd622a4e">
Nov 13 20:33:52 user nova-compute[75239]:           <nova:ip type="fixed" address="10.1.1.236" ipVersion="4"/>
Nov 13 20:33:52 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:port uuid="74b0eca2-dc64-4486-8194-83f22572f6af">
Nov 13 20:33:52 user nova-compute[75239]:           <nova:ip type="fixed" address="10.1.1.150" ipVersion="4"/>
Nov 13 20:33:52 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:port uuid="80ebe795-140c-43d3-a071-f9b0ce708bd8">
Nov 13 20:33:52 user nova-compute[75239]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Nov 13 20:33:52 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:port uuid="6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1">
Nov 13 20:33:52 user nova-compute[75239]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Nov 13 20:33:52 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:port uuid="416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea">
Nov 13 20:33:52 user nova-compute[75239]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 20:33:52 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:52 user nova-compute[75239]:         <nova:port uuid="29916a60-1b87-4742-abee-1048131017b8">
Nov 13 20:33:52 user nova-compute[75239]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 20:33:52 user nova-compute[75239]:         </nova:port>
Nov 13 20:33:52 user nova-compute[75239]:       </nova:ports>
Nov 13 20:33:52 user nova-compute[75239]:     </nova:instance>
Nov 13 20:33:52 user nova-compute[75239]:   </metadata>
Nov 13 20:33:52 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:33:52 user nova-compute[75239]:     <system>
Nov 13 20:33:52 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:33:52 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:33:52 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:33:52 user nova-compute[75239]:       <entry name="serial">927720cf-b009-4f9d-8e54-1b5cd3788e99</entry>
Nov 13 20:33:52 user nova-compute[75239]:       <entry name="uuid">927720cf-b009-4f9d-8e54-1b5cd3788e99</entry>
Nov 13 20:33:52 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:33:52 user nova-compute[75239]:     </system>
Nov 13 20:33:52 user nova-compute[75239]:   </sysinfo>
Nov 13 20:33:52 user nova-compute[75239]:   <os>
Nov 13 20:33:52 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:33:52 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:33:52 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:33:52 user nova-compute[75239]:   </os>
Nov 13 20:33:52 user nova-compute[75239]:   <features>
Nov 13 20:33:52 user nova-compute[75239]:     <acpi/>
Nov 13 20:33:52 user nova-compute[75239]:     <apic/>
Nov 13 20:33:52 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:33:52 user nova-compute[75239]:   </features>
Nov 13 20:33:52 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:33:52 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:33:52 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:33:52 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:33:52 user nova-compute[75239]:   </clock>
Nov 13 20:33:52 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:33:52 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:33:52 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:33:52 user nova-compute[75239]:   </cpu>
Nov 13 20:33:52 user nova-compute[75239]:   <devices>
Nov 13 20:33:52 user nova-compute[75239]:     <disk type="file" device="cdrom">
Nov 13 20:33:52 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 20:33:52 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/927720cf-b009-4f9d-8e54-1b5cd3788e99/disk.config"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="hda" bus="ide"/>
Nov 13 20:33:52 user nova-compute[75239]:     </disk>
Nov 13 20:33:52 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:33:52 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:33:52 user nova-compute[75239]:       <source dev="/dev/sdb"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <serial>fb9b6eaf-a319-41f0-832c-45b27222a389</serial>
Nov 13 20:33:52 user nova-compute[75239]:     </disk>
Nov 13 20:33:52 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:33:52 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:33:52 user nova-compute[75239]:       <source dev="/dev/sdc"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <serial>b99047d9-b258-4356-976e-d5ebd844aecf</serial>
Nov 13 20:33:52 user nova-compute[75239]:     </disk>
Nov 13 20:33:52 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:33:52 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:33:52 user nova-compute[75239]:       <source dev="/dev/sdd"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="vdc" bus="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <serial>47c5c4cd-42e5-481c-83d6-fc9641554b80</serial>
Nov 13 20:33:52 user nova-compute[75239]:     </disk>
Nov 13 20:33:52 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:52 user nova-compute[75239]:       <mac address="fa:16:3e:13:7c:4f"/>
Nov 13 20:33:52 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="tap5b3076cd-3c"/>
Nov 13 20:33:52 user nova-compute[75239]:     </interface>
Nov 13 20:33:52 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:52 user nova-compute[75239]:       <mac address="fa:16:3e:00:d8:af"/>
Nov 13 20:33:52 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="tap96cbdec2-47"/>
Nov 13 20:33:52 user nova-compute[75239]:     </interface>
Nov 13 20:33:52 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:52 user nova-compute[75239]:       <mac address="fa:16:3e:6e:97:c3"/>
Nov 13 20:33:52 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="tap74b0eca2-dc"/>
Nov 13 20:33:52 user nova-compute[75239]:     </interface>
Nov 13 20:33:52 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:52 user nova-compute[75239]:       <mac address="fa:16:3e:54:77:64"/>
Nov 13 20:33:52 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="tap80ebe795-14"/>
Nov 13 20:33:52 user nova-compute[75239]:     </interface>
Nov 13 20:33:52 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:52 user nova-compute[75239]:       <mac address="fa:16:3e:ef:68:49"/>
Nov 13 20:33:52 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="tap6fcd02c3-9f"/>
Nov 13 20:33:52 user nova-compute[75239]:     </interface>
Nov 13 20:33:52 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:52 user nova-compute[75239]:       <mac address="fa:16:3e:8b:e0:61"/>
Nov 13 20:33:52 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="tap416fe38c-01"/>
Nov 13 20:33:52 user nova-compute[75239]:     </interface>
Nov 13 20:33:52 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:33:52 user nova-compute[75239]:       <mac address="fa:16:3e:c1:c7:8b"/>
Nov 13 20:33:52 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:33:52 user nova-compute[75239]:       <target dev="tap29916a60-1b"/>
Nov 13 20:33:52 user nova-compute[75239]:     </interface>
Nov 13 20:33:52 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:33:52 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/927720cf-b009-4f9d-8e54-1b5cd3788e99/console.log" append="off"/>
Nov 13 20:33:52 user nova-compute[75239]:     </serial>
Nov 13 20:33:52 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:33:52 user nova-compute[75239]:     <video>
Nov 13 20:33:52 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:33:52 user nova-compute[75239]:     </video>
Nov 13 20:33:52 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:33:52 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:33:52 user nova-compute[75239]:     </rng>
Nov 13 20:33:52 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:33:52 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:33:52 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:33:52 user nova-compute[75239]:     </memballoon>
Nov 13 20:33:52 user nova-compute[75239]:   </devices>
Nov 13 20:33:52 user nova-compute[75239]: </domain>
Nov 13 20:33:52 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:7c:4f,bridge_name='br-int',has_traffic_filtering=True,id=5b3076cd-3c9c-4261-9361-c18fb53f1a38,network=Network(000df844-a6fb-4c88-b39f-2adbfe4693af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3076cd-3c') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:7c:4f,bridge_name='br-int',has_traffic_filtering=True,id=5b3076cd-3c9c-4261-9361-c18fb53f1a38,network=Network(000df844-a6fb-4c88-b39f-2adbfe4693af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3076cd-3c') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '419bf419-5b8c-564f-aa15-cae8ae337f6e', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b3076cd-3c, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b3076cd-3c, col_values=(('qos', UUID('bbac6175-0175-4bb8-b2e0-9986347ce184')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b3076cd-3c, col_values=(('external_ids', {'iface-id': '5b3076cd-3c9c-4261-9361-c18fb53f1a38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:7c:4f', 'vm-uuid': '927720cf-b009-4f9d-8e54-1b5cd3788e99'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: INFO os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:7c:4f,bridge_name='br-int',has_traffic_filtering=True,id=5b3076cd-3c9c-4261-9361-c18fb53f1a38,network=Network(000df844-a6fb-4c88-b39f-2adbfe4693af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3076cd-3c')
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:af,bridge_name='br-int',has_traffic_filtering=True,id=96cbdec2-4706-42b7-aaa4-5eeabd622a4e,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96cbdec2-47') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:af,bridge_name='br-int',has_traffic_filtering=True,id=96cbdec2-4706-42b7-aaa4-5eeabd622a4e,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96cbdec2-47') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '828f79ee-5f28-5ce8-bda4-42b9804cb193', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96cbdec2-47, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96cbdec2-47, col_values=(('qos', UUID('d51599a3-20e2-4e71-b638-11bf3415b1da')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96cbdec2-47, col_values=(('external_ids', {'iface-id': '96cbdec2-4706-42b7-aaa4-5eeabd622a4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:d8:af', 'vm-uuid': '927720cf-b009-4f9d-8e54-1b5cd3788e99'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: INFO os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:af,bridge_name='br-int',has_traffic_filtering=True,id=96cbdec2-4706-42b7-aaa4-5eeabd622a4e,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96cbdec2-47')
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=74b0eca2-dc64-4486-8194-83f22572f6af,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74b0eca2-dc') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=74b0eca2-dc64-4486-8194-83f22572f6af,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74b0eca2-dc') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d75b979-eaa0-52bf-8b21-ffbc2aea2171', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74b0eca2-dc, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74b0eca2-dc, col_values=(('qos', UUID('251f98bd-dfe7-4564-a753-49a5c9910b50')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74b0eca2-dc, col_values=(('external_ids', {'iface-id': '74b0eca2-dc64-4486-8194-83f22572f6af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:97:c3', 'vm-uuid': '927720cf-b009-4f9d-8e54-1b5cd3788e99'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: INFO os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=74b0eca2-dc64-4486-8194-83f22572f6af,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74b0eca2-dc')
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:64,bridge_name='br-int',has_traffic_filtering=True,id=80ebe795-140c-43d3-a071-f9b0ce708bd8,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ebe795-14') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:64,bridge_name='br-int',has_traffic_filtering=True,id=80ebe795-140c-43d3-a071-f9b0ce708bd8,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ebe795-14') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '670fb8d2-c7e1-51c3-9152-1e0a6f09033a', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80ebe795-14, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80ebe795-14, col_values=(('qos', UUID('705617ae-1bc6-435f-820b-5202bb248d09')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80ebe795-14, col_values=(('external_ids', {'iface-id': '80ebe795-140c-43d3-a071-f9b0ce708bd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:77:64', 'vm-uuid': '927720cf-b009-4f9d-8e54-1b5cd3788e99'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: INFO os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:64,bridge_name='br-int',has_traffic_filtering=True,id=80ebe795-140c-43d3-a071-f9b0ce708bd8,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ebe795-14')
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:68:49,bridge_name='br-int',has_traffic_filtering=True,id=6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fcd02c3-9f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:68:49,bridge_name='br-int',has_traffic_filtering=True,id=6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fcd02c3-9f') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97f7be73-67cc-5383-ab85-372b673049f1', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fcd02c3-9f, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fcd02c3-9f, col_values=(('qos', UUID('0e3b5cab-1227-4679-b40f-e7afc9260fa0')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fcd02c3-9f, col_values=(('external_ids', {'iface-id': '6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:68:49', 'vm-uuid': '927720cf-b009-4f9d-8e54-1b5cd3788e99'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: INFO os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:68:49,bridge_name='br-int',has_traffic_filtering=True,id=6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fcd02c3-9f')
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:61,bridge_name='br-int',has_traffic_filtering=True,id=416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe38c-01') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:61,bridge_name='br-int',has_traffic_filtering=True,id=416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe38c-01') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '470f7f2b-dbfe-5fad-afbc-971819ed1426', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap416fe38c-01, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap416fe38c-01, col_values=(('qos', UUID('3316125c-f7ca-4b80-868b-1e9a4c5c9bb5')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap416fe38c-01, col_values=(('external_ids', {'iface-id': '416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:e0:61', 'vm-uuid': '927720cf-b009-4f9d-8e54-1b5cd3788e99'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: INFO os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:61,bridge_name='br-int',has_traffic_filtering=True,id=416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe38c-01')
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:8b,bridge_name='br-int',has_traffic_filtering=True,id=29916a60-1b87-4742-abee-1048131017b8,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29916a60-1b') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:8b,bridge_name='br-int',has_traffic_filtering=True,id=29916a60-1b87-4742-abee-1048131017b8,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29916a60-1b') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f82cd4e7-ed38-5895-8bc0-f18c4e74aa1e', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29916a60-1b, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29916a60-1b, col_values=(('qos', UUID('3cb79b79-5140-43dd-a2ae-7c1213195118')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29916a60-1b, col_values=(('external_ids', {'iface-id': '29916a60-1b87-4742-abee-1048131017b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:c7:8b', 'vm-uuid': '927720cf-b009-4f9d-8e54-1b5cd3788e99'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:53 user nova-compute[75239]: INFO os_vif [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:8b,bridge_name='br-int',has_traffic_filtering=True,id=29916a60-1b87-4742-abee-1048131017b8,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29916a60-1b')
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] No BDM found with device name hda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] No VIF found with MAC fa:16:3e:13:7c:4f, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] No VIF found with MAC fa:16:3e:ef:68:49, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:33:53 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Using config drive
Nov 13 20:33:53 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Creating config drive at /opt/stack/data/nova/instances/927720cf-b009-4f9d-8e54-1b5cd3788e99/disk.config
Nov 13 20:33:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/927720cf-b009-4f9d-8e54-1b5cd3788e99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmijnoyj4 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:33:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/927720cf-b009-4f9d-8e54-1b5cd3788e99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmijnoyj4" returned: 0 in 0.060s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-2371ffdc-424c-44e8-bb67-fad2115f7d7e req-de4a5fe4-2594-4ed6-b850-29b15a21d83e service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2371ffdc-424c-44e8-bb67-fad2115f7d7e req-de4a5fe4-2594-4ed6-b850-29b15a21d83e service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2371ffdc-424c-44e8-bb67-fad2115f7d7e req-de4a5fe4-2594-4ed6-b850-29b15a21d83e service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2371ffdc-424c-44e8-bb67-fad2115f7d7e req-de4a5fe4-2594-4ed6-b850-29b15a21d83e service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-2371ffdc-424c-44e8-bb67-fad2115f7d7e req-de4a5fe4-2594-4ed6-b850-29b15a21d83e service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:55 user nova-compute[75239]: WARNING nova.compute.manager [req-2371ffdc-424c-44e8-bb67-fad2115f7d7e req-de4a5fe4-2594-4ed6-b850-29b15a21d83e service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 for instance with vm_state building and task_state spawning.
Nov 13 20:33:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-d46f2c8e-a5a8-4291-b787-6fc414f7a7d8 req-ffa5232c-4339-4910-9e40-b552424cd755 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d46f2c8e-a5a8-4291-b787-6fc414f7a7d8 req-ffa5232c-4339-4910-9e40-b552424cd755 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d46f2c8e-a5a8-4291-b787-6fc414f7a7d8 req-ffa5232c-4339-4910-9e40-b552424cd755 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d46f2c8e-a5a8-4291-b787-6fc414f7a7d8 req-ffa5232c-4339-4910-9e40-b552424cd755 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-d46f2c8e-a5a8-4291-b787-6fc414f7a7d8 req-ffa5232c-4339-4910-9e40-b552424cd755 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:56 user nova-compute[75239]: WARNING nova.compute.manager [req-d46f2c8e-a5a8-4291-b787-6fc414f7a7d8 req-ffa5232c-4339-4910-9e40-b552424cd755 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e for instance with vm_state building and task_state spawning.
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-ab935848-e7e6-455c-bd48-e13479c65aae req-21fd627e-3ad1-4541-a84c-7e7d5c881711 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ab935848-e7e6-455c-bd48-e13479c65aae req-21fd627e-3ad1-4541-a84c-7e7d5c881711 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ab935848-e7e6-455c-bd48-e13479c65aae req-21fd627e-3ad1-4541-a84c-7e7d5c881711 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ab935848-e7e6-455c-bd48-e13479c65aae req-21fd627e-3ad1-4541-a84c-7e7d5c881711 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-ab935848-e7e6-455c-bd48-e13479c65aae req-21fd627e-3ad1-4541-a84c-7e7d5c881711 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:56 user nova-compute[75239]: WARNING nova.compute.manager [req-ab935848-e7e6-455c-bd48-e13479c65aae req-21fd627e-3ad1-4541-a84c-7e7d5c881711 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 for instance with vm_state building and task_state spawning.
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:57 user nova-compute[75239]: WARNING nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 for instance with vm_state building and task_state spawning.
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:57 user nova-compute[75239]: WARNING nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-74b0eca2-dc64-4486-8194-83f22572f6af for instance with vm_state building and task_state spawning.
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:57 user nova-compute[75239]: WARNING nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-74b0eca2-dc64-4486-8194-83f22572f6af for instance with vm_state building and task_state spawning.
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:57 user nova-compute[75239]: WARNING nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 for instance with vm_state building and task_state spawning.
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:57 user nova-compute[75239]: WARNING nova.compute.manager [req-21d136a6-b980-440a-84eb-58b8b7aa5386 req-ff36e77c-2c48-4ab8-911f-2594e0ff2a78 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 for instance with vm_state building and task_state spawning.
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:58 user nova-compute[75239]: WARNING nova.compute.manager [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e for instance with vm_state building and task_state spawning.
Nov 13 20:33:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:58 user nova-compute[75239]: WARNING nova.compute.manager [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-29916a60-1b87-4742-abee-1048131017b8 for instance with vm_state building and task_state spawning.
Nov 13 20:33:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:58 user nova-compute[75239]: WARNING nova.compute.manager [req-473d5950-82e4-4bc9-a608-b4acdf707299 req-42b7d943-6bad-4470-b5be-36b39d0fb27a service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-29916a60-1b87-4742-abee-1048131017b8 for instance with vm_state building and task_state spawning.
Nov 13 20:33:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-b46c787e-8e9e-45b2-a24e-1c4eda10eee8 req-d2bc457c-b574-4c1a-98ca-f1674cf557ed service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b46c787e-8e9e-45b2-a24e-1c4eda10eee8 req-d2bc457c-b574-4c1a-98ca-f1674cf557ed service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b46c787e-8e9e-45b2-a24e-1c4eda10eee8 req-d2bc457c-b574-4c1a-98ca-f1674cf557ed service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b46c787e-8e9e-45b2-a24e-1c4eda10eee8 req-d2bc457c-b574-4c1a-98ca-f1674cf557ed service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-b46c787e-8e9e-45b2-a24e-1c4eda10eee8 req-d2bc457c-b574-4c1a-98ca-f1674cf557ed service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:58 user nova-compute[75239]: WARNING nova.compute.manager [req-b46c787e-8e9e-45b2-a24e-1c4eda10eee8 req-d2bc457c-b574-4c1a-98ca-f1674cf557ed service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 for instance with vm_state building and task_state spawning.
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:59 user nova-compute[75239]: WARNING nova.compute.manager [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea for instance with vm_state building and task_state spawning.
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:33:59 user nova-compute[75239]: WARNING nova.compute.manager [req-62a4e5b9-5d6f-4469-b3d6-efca95655ea3 req-1b37f5e1-cf62-4e50-bc3d-5d0f116de697 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea for instance with vm_state building and task_state spawning.
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:33:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance spawned successfully.
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:33:59 user nova-compute[75239]: INFO nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Took 11.30 seconds to spawn the instance on the hypervisor.
Nov 13 20:33:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:33:59 user nova-compute[75239]: INFO nova.compute.manager [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Took 29.99 seconds to build instance.
Nov 13 20:34:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-07180109-f21c-4a88-aaed-a12c7b1a4087 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.616s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:34:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 20:34:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:34:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:34:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "5771f282-957f-4c19-8e50-0d85248a8605" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG nova.objects.instance [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lazy-loading 'flavor' on Instance uuid 5771f282-957f-4c19-8e50-0d85248a8605 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "5771f282-957f-4c19-8e50-0d85248a8605" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:20 user nova-compute[75239]: INFO nova.compute.manager [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Attaching volume e53467c8-be5d-4643-af31-81c986ebba18 to /dev/vdb
Nov 13 20:34:20 user nova-compute[75239]: DEBUG os_brick.utils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[13844a48-98cb-4963-93c1-85c04ace3606]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f73d8c-0d57-4c7c-81f5-20755222fbda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8e271a-3445-4bde-8906-1d091dd061b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586e003-779c-44b3-8325-a28073715d19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:21 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:34:21 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd2e26e-8df3-4497-b020-3b3fb80d536d]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG os_brick.utils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:21 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Updating existing volume attachment record: 9750699a-0a9d-435f-aa4a-30a4349ea5c9 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:34:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-c51d26a6-3046-4f34-866a-e43541b1cf73 req-4195bf88-cd2a-40a6-874c-13499db28950 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-changed-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-c51d26a6-3046-4f34-866a-e43541b1cf73 req-4195bf88-cd2a-40a6-874c-13499db28950 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Refreshing instance network info cache due to event network-changed-af2c8770-f7b4-4446-8061-7c377b8ad1f5. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:34:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c51d26a6-3046-4f34-866a-e43541b1cf73 req-4195bf88-cd2a-40a6-874c-13499db28950 service nova] Acquiring lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:34:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c51d26a6-3046-4f34-866a-e43541b1cf73 req-4195bf88-cd2a-40a6-874c-13499db28950 service nova] Acquired lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:34:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-c51d26a6-3046-4f34-866a-e43541b1cf73 req-4195bf88-cd2a-40a6-874c-13499db28950 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Refreshing network info cache for port af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:34:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-c51d26a6-3046-4f34-866a-e43541b1cf73 req-4195bf88-cd2a-40a6-874c-13499db28950 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updated VIF entry in instance network info cache for port af2c8770-f7b4-4446-8061-7c377b8ad1f5. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:34:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-c51d26a6-3046-4f34-866a-e43541b1cf73 req-4195bf88-cd2a-40a6-874c-13499db28950 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating instance_info_cache with network_info: [{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:34:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c51d26a6-3046-4f34-866a-e43541b1cf73 req-4195bf88-cd2a-40a6-874c-13499db28950 service nova] Releasing lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-a5626513-c53f-45ad-a92a-28c0db0880b2 req-3901ca3b-9178-4b4f-b8f0-14afbb69df04 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received event network-changed-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-a5626513-c53f-45ad-a92a-28c0db0880b2 req-3901ca3b-9178-4b4f-b8f0-14afbb69df04 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Refreshing instance network info cache due to event network-changed-0da27379-6537-4987-ad38-12e5e1d9f277. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a5626513-c53f-45ad-a92a-28c0db0880b2 req-3901ca3b-9178-4b4f-b8f0-14afbb69df04 service nova] Acquiring lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a5626513-c53f-45ad-a92a-28c0db0880b2 req-3901ca3b-9178-4b4f-b8f0-14afbb69df04 service nova] Acquired lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:34:24 user nova-compute[75239]: DEBUG nova.network.neutron [req-a5626513-c53f-45ad-a92a-28c0db0880b2 req-3901ca3b-9178-4b4f-b8f0-14afbb69df04 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Refreshing network info cache for port 0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.159s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGSTkVHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:25 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:25 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:25 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee3515f-a441-44b7-b712-7dadb8311287]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:34:25 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[176401e5-adff-4095-a1a5-8aa03df6f7fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18] added
Nov 13 20:34:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17ade45-81eb-4a95-824c-00f1b3d1e12e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:25 user nova-compute[75239]: INFO nova.compute.manager [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Attaching volume 211604d0-2297-4169-9d9f-1034e5ff23b0 to /dev/vdb
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ef18ed-1d9d-4b84-a396-6054ddb6f247]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGSTkVHC {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG nova.network.neutron [req-a5626513-c53f-45ad-a92a-28c0db0880b2 req-3901ca3b-9178-4b4f-b8f0-14afbb69df04 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updated VIF entry in instance network info cache for port 0da27379-6537-4987-ad38-12e5e1d9f277. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG nova.network.neutron [req-a5626513-c53f-45ad-a92a-28c0db0880b2 req-3901ca3b-9178-4b4f-b8f0-14afbb69df04 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updating instance_info_cache with network_info: [{"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGSTkVHC" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f2ef7d-5645-495a-bc3a-438c9e44c25c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RGSTkVHC'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.utils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19b7422-bd27-4fdc-9d8d-15b81af0d22d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a5626513-c53f-45ad-a92a-28c0db0880b2 req-3901ca3b-9178-4b4f-b8f0-14afbb69df04 service nova] Releasing lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7fb383-35bc-4cf6-86b0-9736d1b50255]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[915c11e3-a8a6-4b64-9998-5acece292da4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2573edda-1445-4f5b-8386-c68f313c1c4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17f74c-b4de-4c86-b353-b1847ef311f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[af220ecc-3481-4e0a-ac82-873a5cbf4a66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc861e5a-57e0-4d18-a906-6af650cdec89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18, portal: 172.16.0.220,3260]
Nov 13 20:34:25 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18, portal: 172.16.0.220,3260] successful.
Nov 13 20:34:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:25 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d45b3e1-6c8c-4ced-8268-6bd36f40d0cc]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.utils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating existing volume attachment record: 2a905e13-d364-4142-a70c-54e0a6be568e {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[14da8fe7-6f8e-4629-bbb3-1ee94c826a3c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6518409-13ee-42d3-b04a-4fc60c45366f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 (non-flash)
Nov 13 20:34:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b28b38-f5ed-4468-b1a3-6de21987c132]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGSTkVHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG nova.compute.manager [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:34:26 user nova-compute[75239]: INFO nova.compute.manager [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] instance snapshotting
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Beginning live snapshot process
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json -f qcow2 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.164s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json -f qcow2 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23139646365326233', 'path': '/dev/sde'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139646365326233', 'path': '/dev/sde'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG nova.objects.instance [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lazy-loading 'flavor' on Instance uuid 5771f282-957f-4c19-8e50-0d85248a8605 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:34:26 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:34:26 user nova-compute[75239]:   <source dev="/dev/sde"/>
Nov 13 20:34:26 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:34:26 user nova-compute[75239]:   <serial>e53467c8-be5d-4643-af31-81c986ebba18</serial>
Nov 13 20:34:26 user nova-compute[75239]: </disk>
Nov 13 20:34:26 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiluk6ncg/e39eb32b7614439b94f43ba04e9a3bb2.delta 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiluk6ncg/e39eb32b7614439b94f43ba04e9a3bb2.delta 1073741824" returned: 0 in 0.045s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:27 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 20:34:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75239) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 13 20:34:27 user nova-compute[75239]: INFO nova.virt.libvirt.host [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] UEFI support detected
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] No VIF found with MAC fa:16:3e:79:d4:a5, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-067197ed-e3fe-4fb7-bb60-8fc73dc4b466 tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.667s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] COPY block job progress, current cursor: 327680 final cursor: 75497472 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-393c1589-0b64-4243-9a3c-946ab7c7dcc9 req-d6b73f76-0d5f-4007-ab66-cbfd93977eac service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-changed-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-393c1589-0b64-4243-9a3c-946ab7c7dcc9 req-d6b73f76-0d5f-4007-ab66-cbfd93977eac service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Refreshing instance network info cache due to event network-changed-8e91bea0-dea9-49f6-ac95-f485a29d5cd2. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-393c1589-0b64-4243-9a3c-946ab7c7dcc9 req-d6b73f76-0d5f-4007-ab66-cbfd93977eac service nova] Acquiring lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-393c1589-0b64-4243-9a3c-946ab7c7dcc9 req-d6b73f76-0d5f-4007-ab66-cbfd93977eac service nova] Acquired lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-393c1589-0b64-4243-9a3c-946ab7c7dcc9 req-d6b73f76-0d5f-4007-ab66-cbfd93977eac service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Refreshing network info cache for port 8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:34:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 20:34:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:34:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:34:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=6845MB free_disk=25.35672378540039GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "5771f282-957f-4c19-8e50-0d85248a8605" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "5771f282-957f-4c19-8e50-0d85248a8605-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:29 user nova-compute[75239]: INFO nova.compute.manager [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Terminating instance
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiluk6ncg/e39eb32b7614439b94f43ba04e9a3bb2.delta /opt/stack/data/nova/instances/snapshots/tmpiluk6ncg/e39eb32b7614439b94f43ba04e9a3bb2 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 5771f282-957f-4c19-8e50-0d85248a8605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d67fcb6b-fb37-4d04-8dab-d74370f76981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ae8531d9-3930-4373-91b2-628d850e8ba7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4577b5eb-6acf-4616-931b-28b5ef72d739 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 9373b4cc-900f-4657-8d3c-b9b87746b73b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 927720cf-b009-4f9d-8e54-1b5cd3788e99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiluk6ncg/e39eb32b7614439b94f43ba04e9a3bb2.delta /opt/stack/data/nova/instances/snapshots/tmpiluk6ncg/e39eb32b7614439b94f43ba04e9a3bb2" returned: 0 in 0.576s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:29 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Snapshot extracted, beginning image upload
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.network.neutron [req-393c1589-0b64-4243-9a3c-946ab7c7dcc9 req-d6b73f76-0d5f-4007-ab66-cbfd93977eac service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updated VIF entry in instance network info cache for port 8e91bea0-dea9-49f6-ac95-f485a29d5cd2. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.network.neutron [req-393c1589-0b64-4243-9a3c-946ab7c7dcc9 req-d6b73f76-0d5f-4007-ab66-cbfd93977eac service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating instance_info_cache with network_info: [{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-393c1589-0b64-4243-9a3c-946ab7c7dcc9 req-d6b73f76-0d5f-4007-ab66-cbfd93977eac service nova] Releasing lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.806s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:29 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Instance destroyed successfully.
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.objects.instance [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lazy-loading 'resources' on Instance uuid 5771f282-957f-4c19-8e50-0d85248a8605 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-472268224',display_name='tempest-DeleteServersTestJSON-server-472268224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-472268224',id=1,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43a004ca2b494127b60d661613aecdc1',ramdisk_id='',reservation_id='r-g50hbf0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-636220024',owner_user_name='tempest-DeleteServersTestJSON-636220024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:32:42Z,user_data=None,user_id='5a71d5dd4e524fb6ad98d7c1de9c383b',uuid=5771f282-957f-4c19-8e50-0d85248a8605,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Converting VIF {"id": "0bb0198a-395e-45fb-88cd-53909c6b5521", "address": "fa:16:3e:79:d4:a5", "network": {"id": "fd590099-f604-4b86-8a7e-cba82ec0feb4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-592274688-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43a004ca2b494127b60d661613aecdc1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0bb0198a-39", "ovs_interfaceid": "0bb0198a-395e-45fb-88cd-53909c6b5521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:d4:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bb0198a-395e-45fb-88cd-53909c6b5521,network=Network(fd590099-f604-4b86-8a7e-cba82ec0feb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb0198a-39') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_vif [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:d4:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bb0198a-395e-45fb-88cd-53909c6b5521,network=Network(fd590099-f604-4b86-8a7e-cba82ec0feb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb0198a-39') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0bb0198a-39, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=083c7811-5af9-4a31-b5a1-0875b975896c) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:29 user nova-compute[75239]: INFO os_vif [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:d4:a5,bridge_name='br-int',has_traffic_filtering=True,id=0bb0198a-395e-45fb-88cd-53909c6b5521,network=Network(fd590099-f604-4b86-8a7e-cba82ec0feb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0bb0198a-39')
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGSTkVHC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:29 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c4ec3c-0bba-40d0-9b44-3b12db590a6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:34:29 user nova-compute[75239]: No targets found.
Nov 13 20:34:29 user nova-compute[75239]: iSNS:
Nov 13 20:34:29 user nova-compute[75239]: No targets found.
Nov 13 20:34:29 user nova-compute[75239]: STATIC:
Nov 13 20:34:29 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80
Nov 13 20:34:29 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:34:29 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:34:29 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389
Nov 13 20:34:29 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:34:29 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:34:29 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf
Nov 13 20:34:29 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:34:29 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:34:29 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18
Nov 13 20:34:29 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:34:29 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:34:29 user nova-compute[75239]: FIRMWARE:
Nov 13 20:34:29 user nova-compute[75239]: No targets found.
Nov 13 20:34:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:34:29 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:34:29 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[413baf23-2f0e-4793-85ec-9d85ad0f0016]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bfd526-9060-4829-bd47-03e86dd77b69]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:29 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:29 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:29 user nova-compute[75239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 (non-flash)
Nov 13 20:34:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:29 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:29 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:29 user nova-compute[75239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 (non-flash)
Nov 13 20:34:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d842a05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18'): ({'sde'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Removing single pathed devices sde {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSfhYNrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:29 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9b8573-d63d-4821-9d9a-a1197d8da9b0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[708f6463-5b6e-4856-a090-858232f1bdbd]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Flushing IO for device /dev/sde {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: INFO nova.compute.manager [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] instance snapshotting
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6fc4e1-b7d6-4cf8-9e6d-9370b95687ee]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e38ac-6590-4f2f-b750-3d9efecd589c]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Beginning live snapshot process
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dce1210-66c6-4e52-9b99-43ca61084e20]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce2fe7b-0c49-48a6-b5c7-d668a73112c3]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18, portal: 172.16.0.220,3260]
Nov 13 20:34:30 user nova-compute[75239]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18, portal: 172.16.0.220,3260] successful.
Nov 13 20:34:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e53467c8-be5d-4643-af31-81c986ebba18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d90fcb-53a6-44ca-8c59-67222143c606]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] <== disconnect_volume: return (325ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:34:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Deleting instance files /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605_del
Nov 13 20:34:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Deletion of /opt/stack/data/nova/instances/5771f282-957f-4c19-8e50-0d85248a8605_del complete
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.233s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:30 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:30 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8148a2-3da5-4769-b408-97935140ebc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:34:30 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9695d0-4054-45cb-bc03-4e0e5f154efc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0] added
Nov 13 20:34:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json -f qcow2 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e60c4-5c76-40cd-a063-4b3918dad413]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: INFO nova.compute.manager [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcdd408-6697-44d8-bc01-cacd5e894e4f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSfhYNrF {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSfhYNrF" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d03b8fa-87df-4bc3-8761-e1801f0706cb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jSfhYNrF'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a3beed-badf-4217-8990-6700fc4d2829]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab7eaa7-8d46-4cc0-bed8-f20352e04cf3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json -f qcow2 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32fc5f8-7f22-4def-ace5-474e1958d102]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260]
Nov 13 20:34:30 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260] successful.
Nov 13 20:34:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4165bb-8f45-4728-8d13-7f80be74bd4c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[05975cde-4443-4088-84b1-ba3d4942023c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0d0e38-d18c-428a-86dc-adbdf6208d3c]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSfhYNrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received event network-vif-unplugged-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] Acquiring lock "5771f282-957f-4c19-8e50-0d85248a8605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] No waiting events found dispatching network-vif-unplugged-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received event network-vif-unplugged-0bb0198a-395e-45fb-88cd-53909c6b5521 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received event network-vif-plugged-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] Acquiring lock "5771f282-957f-4c19-8e50-0d85248a8605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] Lock "5771f282-957f-4c19-8e50-0d85248a8605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] No waiting events found dispatching network-vif-plugged-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:34:30 user nova-compute[75239]: WARNING nova.compute.manager [req-b3f6da54-42f7-4831-bd85-562de80a64fa req-d291e158-d0ee-42ec-9dc4-480caa38f32b service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received unexpected event network-vif-plugged-0bb0198a-395e-45fb-88cd-53909c6b5521 for instance with vm_state active and task_state deleting.
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc7w4e8tk/a10fdd91c0a14f73ae738e702f733580.delta 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc7w4e8tk/a10fdd91c0a14f73ae738e702f733580.delta 1073741824" returned: 0 in 0.053s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 20:34:30 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:34:30 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Took 0.61 seconds to deallocate network for instance.
Nov 13 20:34:31 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== connect_volume: return (1639ms) {'type': 'block', 'scsi_wwn': '23832613432626264', 'path': '/dev/sde'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832613432626264', 'path': '/dev/sde'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:34:31 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:34:31 user nova-compute[75239]:   <source dev="/dev/sde"/>
Nov 13 20:34:31 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:34:31 user nova-compute[75239]:   <serial>211604d0-2297-4169-9d9f-1034e5ff23b0</serial>
Nov 13 20:34:31 user nova-compute[75239]: </disk>
Nov 13 20:34:31 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:34:31 user nova-compute[75239]: INFO nova.compute.manager [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Took 0.78 seconds to detach 1 volumes for instance.
Nov 13 20:34:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:31 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating instance_info_cache with network_info: [{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No VIF found with MAC fa:16:3e:9f:11:19, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:34:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 20:34:32 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc7w4e8tk/a10fdd91c0a14f73ae738e702f733580.delta /opt/stack/data/nova/instances/snapshots/tmpc7w4e8tk/a10fdd91c0a14f73ae738e702f733580 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e95ccb8e-0dc3-4e24-a9a3-ce29f1b4e4f0 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.866s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Snapshot image upload complete
Nov 13 20:34:32 user nova-compute[75239]: INFO nova.compute.manager [None req-65e2a455-045a-4093-9cd4-c8e2ae23a8a5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Took 6.11 seconds to snapshot the instance on the hypervisor.
Nov 13 20:34:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.569s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:32 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Deleted allocations for instance 5771f282-957f-4c19-8e50-0d85248a8605
Nov 13 20:34:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc7w4e8tk/a10fdd91c0a14f73ae738e702f733580.delta /opt/stack/data/nova/instances/snapshots/tmpc7w4e8tk/a10fdd91c0a14f73ae738e702f733580" returned: 0 in 0.280s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Snapshot extracted, beginning image upload
Nov 13 20:34:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82d3f9c3-ab6c-49f8-87b7-4ee14635f55a tempest-DeleteServersTestJSON-636220024 tempest-DeleteServersTestJSON-636220024-project-member] Lock "5771f282-957f-4c19-8e50-0d85248a8605" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.653s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-07027215-8e50-4822-a166-47e8137ea3dc req-3ede3b83-b49c-4be9-8b1a-75c04944090e service nova] [instance: 5771f282-957f-4c19-8e50-0d85248a8605] Received event network-vif-deleted-0bb0198a-395e-45fb-88cd-53909c6b5521 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5f92b169-2013-4b51-a285-fb6740e28c6f tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5f92b169-2013-4b51-a285-fb6740e28c6f tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5f92b169-2013-4b51-a285-fb6740e28c6f tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5f92b169-2013-4b51-a285-fb6740e28c6f tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75239) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG nova.objects.instance [None req-5f92b169-2013-4b51-a285-fb6740e28c6f tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-c4e7aab7-2508-465d-969c-f2cc48716aa0 req-f4c6a8fa-ae64-484c-9e3c-2150a8678fd4 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c4e7aab7-2508-465d-969c-f2cc48716aa0 req-f4c6a8fa-ae64-484c-9e3c-2150a8678fd4 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c4e7aab7-2508-465d-969c-f2cc48716aa0 req-f4c6a8fa-ae64-484c-9e3c-2150a8678fd4 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c4e7aab7-2508-465d-969c-f2cc48716aa0 req-f4c6a8fa-ae64-484c-9e3c-2150a8678fd4 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-c4e7aab7-2508-465d-969c-f2cc48716aa0 req-f4c6a8fa-ae64-484c-9e3c-2150a8678fd4 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:34:33 user nova-compute[75239]: WARNING nova.compute.manager [req-c4e7aab7-2508-465d-969c-f2cc48716aa0 req-f4c6a8fa-ae64-484c-9e3c-2150a8678fd4 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state active and task_state powering-off.
Nov 13 20:34:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance destroyed successfully.
Nov 13 20:34:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5f92b169-2013-4b51-a285-fb6740e28c6f tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:34:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5f92b169-2013-4b51-a285-fb6740e28c6f tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.853s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Snapshot image upload complete
Nov 13 20:34:35 user nova-compute[75239]: INFO nova.compute.manager [None req-51c439c6-8fe4-4fa8-9b5a-2f0244ddc60a tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Took 5.44 seconds to snapshot the instance on the hypervisor.
Nov 13 20:34:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-0b7b01b4-33c5-46d6-bcfa-24521871d0b9 req-4dd08601-4840-4828-a7e3-a2a539aab36b service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0b7b01b4-33c5-46d6-bcfa-24521871d0b9 req-4dd08601-4840-4828-a7e3-a2a539aab36b service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0b7b01b4-33c5-46d6-bcfa-24521871d0b9 req-4dd08601-4840-4828-a7e3-a2a539aab36b service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0b7b01b4-33c5-46d6-bcfa-24521871d0b9 req-4dd08601-4840-4828-a7e3-a2a539aab36b service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-0b7b01b4-33c5-46d6-bcfa-24521871d0b9 req-4dd08601-4840-4828-a7e3-a2a539aab36b service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:34:35 user nova-compute[75239]: WARNING nova.compute.manager [req-0b7b01b4-33c5-46d6-bcfa-24521871d0b9 req-4dd08601-4840-4828-a7e3-a2a539aab36b service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state None.
Nov 13 20:34:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-9a24341c-4993-42be-b90a-9f34b9a0b13d req-35d2985a-18de-4712-9f1f-f268c50f137d service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received event network-changed-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-9a24341c-4993-42be-b90a-9f34b9a0b13d req-35d2985a-18de-4712-9f1f-f268c50f137d service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Refreshing instance network info cache due to event network-changed-d7bfe0e9-fe15-4a8f-b258-e0ab32209397. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:34:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9a24341c-4993-42be-b90a-9f34b9a0b13d req-35d2985a-18de-4712-9f1f-f268c50f137d service nova] Acquiring lock "refresh_cache-ae8531d9-3930-4373-91b2-628d850e8ba7" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:34:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9a24341c-4993-42be-b90a-9f34b9a0b13d req-35d2985a-18de-4712-9f1f-f268c50f137d service nova] Acquired lock "refresh_cache-ae8531d9-3930-4373-91b2-628d850e8ba7" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:34:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-9a24341c-4993-42be-b90a-9f34b9a0b13d req-35d2985a-18de-4712-9f1f-f268c50f137d service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Refreshing network info cache for port d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:34:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-9a24341c-4993-42be-b90a-9f34b9a0b13d req-35d2985a-18de-4712-9f1f-f268c50f137d service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Updated VIF entry in instance network info cache for port d7bfe0e9-fe15-4a8f-b258-e0ab32209397. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:34:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-9a24341c-4993-42be-b90a-9f34b9a0b13d req-35d2985a-18de-4712-9f1f-f268c50f137d service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Updating instance_info_cache with network_info: [{"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:34:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9a24341c-4993-42be-b90a-9f34b9a0b13d req-35d2985a-18de-4712-9f1f-f268c50f137d service nova] Releasing lock "refresh_cache-ae8531d9-3930-4373-91b2-628d850e8ba7" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lazy-loading 'flavor' on Instance uuid ae8531d9-3930-4373-91b2-628d850e8ba7 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:43 user nova-compute[75239]: INFO nova.compute.manager [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Attaching volume 20b2e8a4-8017-44ee-a233-956dc3a3d7ed to /dev/vdb
Nov 13 20:34:43 user nova-compute[75239]: DEBUG os_brick.utils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1db56d-647c-4b4d-a36d-8b5fa8ec8825]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc089a4e-ad8d-44a3-b851-25d38823b357]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90c6afa-ba21-42fb-937a-e1c2dc1f58e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[edab4a6f-40c9-48f2-afde-bee6030e1bee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:44 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:34:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dae60a-b52a-44cf-b053-c6066e3298c0]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG os_brick.utils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Updating existing volume attachment record: 5dd931ef-325d-4cc8-bb2f-dba9b34eacdc {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:34:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-6e119fad-a279-4de2-82ac-a455cf7459f3 req-19297c02-bbf9-4795-baf1-29c5a854594e service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received event network-changed-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-6e119fad-a279-4de2-82ac-a455cf7459f3 req-19297c02-bbf9-4795-baf1-29c5a854594e service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Refreshing instance network info cache due to event network-changed-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:34:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6e119fad-a279-4de2-82ac-a455cf7459f3 req-19297c02-bbf9-4795-baf1-29c5a854594e service nova] Acquiring lock "refresh_cache-4577b5eb-6acf-4616-931b-28b5ef72d739" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:34:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6e119fad-a279-4de2-82ac-a455cf7459f3 req-19297c02-bbf9-4795-baf1-29c5a854594e service nova] Acquired lock "refresh_cache-4577b5eb-6acf-4616-931b-28b5ef72d739" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:34:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-6e119fad-a279-4de2-82ac-a455cf7459f3 req-19297c02-bbf9-4795-baf1-29c5a854594e service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Refreshing network info cache for port 4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmyhBfHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:48 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:48 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:48 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4fcd73-87eb-4037-91c6-094d2ba2580a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:34:48 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7943fb1-79a4-436e-80ee-4d3032051ed4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed] added
Nov 13 20:34:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e11e77-576a-4bb4-80fa-749a21cbd7d9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6701a23-f5cd-47c2-aec3-38ba9b0ce55e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmyhBfHc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmyhBfHc" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d825a17b-c3f5-4c04-a80c-3acf8544b3be]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CmyhBfHc'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f71e9e5-ac0c-44c6-9234-5f68a23fdcfd]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4a2b29-e696-443e-910e-7f05568913d6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:48 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:48 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:48 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:48 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:48 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:48 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-4f0d9c5c-6672-4877-a3b3-372c75faddbb req-f76821b4-0f8f-4942-a344-b34d7d102dd9 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received event network-changed-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-4f0d9c5c-6672-4877-a3b3-372c75faddbb req-f76821b4-0f8f-4942-a344-b34d7d102dd9 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Refreshing instance network info cache due to event network-changed-e017651b-4710-4d2f-a57a-73401f644453. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4f0d9c5c-6672-4877-a3b3-372c75faddbb req-f76821b4-0f8f-4942-a344-b34d7d102dd9 service nova] Acquiring lock "refresh_cache-ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4f0d9c5c-6672-4877-a3b3-372c75faddbb req-f76821b4-0f8f-4942-a344-b34d7d102dd9 service nova] Acquired lock "refresh_cache-ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-4f0d9c5c-6672-4877-a3b3-372c75faddbb req-f76821b4-0f8f-4942-a344-b34d7d102dd9 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Refreshing network info cache for port e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG nova.objects.instance [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lazy-loading 'flavor' on Instance uuid ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:48 user nova-compute[75239]: INFO nova.compute.manager [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Attaching volume ff71d5c5-9140-4781-9441-4430e66eda16 to /dev/vdb
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.utils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-6e119fad-a279-4de2-82ac-a455cf7459f3 req-19297c02-bbf9-4795-baf1-29c5a854594e service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Updated VIF entry in instance network info cache for port 4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-6e119fad-a279-4de2-82ac-a455cf7459f3 req-19297c02-bbf9-4795-baf1-29c5a854594e service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Updating instance_info_cache with network_info: [{"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40d686e-8767-41ac-898f-bc98d168719a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6e119fad-a279-4de2-82ac-a455cf7459f3 req-19297c02-bbf9-4795-baf1-29c5a854594e service nova] Releasing lock "refresh_cache-4577b5eb-6acf-4616-931b-28b5ef72d739" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcbc760-c10b-41aa-bbd8-00d7d7469b48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8564c7ae-d8af-4e76-bb59-faf738df65b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e665091b-182e-490b-aa52-64fb1bcfc2f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:48 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:34:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1152c0-cdae-4730-98fb-293ab711f32b]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG os_brick.utils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:48 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Updating existing volume attachment record: 6a4270ea-dbd7-4baa-9feb-480b11cabe17 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG nova.network.neutron [req-4f0d9c5c-6672-4877-a3b3-372c75faddbb req-f76821b4-0f8f-4942-a344-b34d7d102dd9 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Updated VIF entry in instance network info cache for port e017651b-4710-4d2f-a57a-73401f644453. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG nova.network.neutron [req-4f0d9c5c-6672-4877-a3b3-372c75faddbb req-f76821b4-0f8f-4942-a344-b34d7d102dd9 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Updating instance_info_cache with network_info: [{"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4f0d9c5c-6672-4877-a3b3-372c75faddbb req-f76821b4-0f8f-4942-a344-b34d7d102dd9 service nova] Releasing lock "refresh_cache-ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lazy-loading 'flavor' on Instance uuid 4577b5eb-6acf-4616-931b-28b5ef72d739 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --login" returned: 0 in 1.072s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8cb33e-2d02-4753-b63b-95b6165d6893]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed, portal: 172.16.0.220,3260]
Nov 13 20:34:49 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed, portal: 172.16.0.220,3260] successful.
Nov 13 20:34:49 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[84089bd2-ff09-476c-875f-a83b52445965]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb982a6b-d847-4c50-95e5-360ef4bad02a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:49 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:49 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:49 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:49 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:49 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:49 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:49 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:49 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:49 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:49 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.295s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0ea6c4-5bf5-457b-be14-33db94665ace]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmyhBfHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:49 user nova-compute[75239]: INFO nova.compute.manager [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Attaching volume 28f66b66-2ead-44be-92d7-404e1d50c2fc to /dev/sdc
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.utils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd13d137-4403-4981-b571-1f21d2c998d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9789702-c2b4-4239-b5eb-29769427ca97]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8963788-8542-42eb-8b5a-972b0038fdf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0579fd27-1fba-423a-8356-fe8856bd2607]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:49 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:34:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cffb52-9bc5-4123-84db-0594fda345f1]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG os_brick.utils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Updating existing volume attachment record: 6763e45b-865b-40e7-974d-8b8aedfc44de {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:34:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.338s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:50 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] <== connect_volume: return (2340ms) {'type': 'block', 'scsi_wwn': '23164346130373836', 'path': '/dev/sdf'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164346130373836', 'path': '/dev/sdf'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:34:50 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lazy-loading 'flavor' on Instance uuid ae8531d9-3930-4373-91b2-628d850e8ba7 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:34:50 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:34:50 user nova-compute[75239]:   <source dev="/dev/sdf"/>
Nov 13 20:34:50 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:34:50 user nova-compute[75239]:   <serial>20b2e8a4-8017-44ee-a233-956dc3a3d7ed</serial>
Nov 13 20:34:50 user nova-compute[75239]: </disk>
Nov 13 20:34:50 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:34:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] No VIF found with MAC fa:16:3e:25:da:7a, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:34:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9d4ddda5-074c-4df3-a888-e2fa309fa77b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.133s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:52 user nova-compute[75239]: INFO nova.compute.manager [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Detaching volume 20b2e8a4-8017-44ee-a233-956dc3a3d7ed
Nov 13 20:34:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:52 user nova-compute[75239]: INFO nova.virt.block_device [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Attempting to driver detach volume 20b2e8a4-8017-44ee-a233-956dc3a3d7ed from mountpoint /dev/vdb
Nov 13 20:34:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Attempting to detach device vdb from instance ae8531d9-3930-4373-91b2-628d850e8ba7 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:34:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:34:52 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:34:52 user nova-compute[75239]:   <source dev="/dev/sdf"/>
Nov 13 20:34:52 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:34:52 user nova-compute[75239]:   <serial>20b2e8a4-8017-44ee-a233-956dc3a3d7ed</serial>
Nov 13 20:34:52 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:34:52 user nova-compute[75239]: </disk>
Nov 13 20:34:52 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:34:52 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Successfully detached device vdb from instance ae8531d9-3930-4373-91b2-628d850e8ba7 from the persistent domain config.
Nov 13 20:34:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae8531d9-3930-4373-91b2-628d850e8ba7 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:34:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:34:52 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:34:52 user nova-compute[75239]:   <source dev="/dev/sdf"/>
Nov 13 20:34:52 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:34:52 user nova-compute[75239]:   <serial>20b2e8a4-8017-44ee-a233-956dc3a3d7ed</serial>
Nov 13 20:34:52 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:34:52 user nova-compute[75239]: </disk>
Nov 13 20:34:52 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:34:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae8531d9-3930-4373-91b2-628d850e8ba7 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjsBFyzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:53 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:53 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:53 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acf4b9d-64ce-4362-9008-53f964d6dd04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:34:53 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c51fef7-27b1-475f-ac96-10327220f525]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16] added
Nov 13 20:34:53 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[754bda33-b92c-43d6-bf7f-cb39d80b0c9c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c881428e-8a41-40c3-a733-cf230b04fffb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjsBFyzm {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjsBFyzm" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67084c08-9cff-4bca-98f7-0bf28665e7be]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fjsBFyzm'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9129d00c-4fb7-4825-b36b-e8fffc72cacf]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5caf11-0554-4550-85e0-d219d7802f17]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:53 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:53 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb749ed-99a8-4853-91c8-c5108503ee3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260]
Nov 13 20:34:53 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260] successful.
Nov 13 20:34:53 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb80a28b-bd1a-4075-a1a8-0ad7a850480a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c286e12b-f41f-48f3-9fa5-92b549b14ec7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:53 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:34:53 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7310a285-976d-40f9-bcb9-6b0723747a49]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjsBFyzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIhNZOnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:53 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23863393162313563', 'path': '/dev/sdg'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863393162313563', 'path': '/dev/sdg'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.604s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:54 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:54 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG nova.objects.instance [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lazy-loading 'flavor' on Instance uuid ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2700c425-eb8d-456f-94a3-f8cc0c4496fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:34:54 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:34:54 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:34:54 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:34:54 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:34:54 user nova-compute[75239]:   <serial>ff71d5c5-9140-4781-9441-4430e66eda16</serial>
Nov 13 20:34:54 user nova-compute[75239]: </disk>
Nov 13 20:34:54 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9d7a3d-b8db-4e81-a21c-9cd625de6671]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc] added
Nov 13 20:34:54 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b234f803-a4e5-4c5c-bf2b-36411da5eeb1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fcfdf5-4aca-4af3-8782-db745cff839e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIhNZOnq {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pIhNZOnq" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f2605f-9a3c-45e8-a4d9-ce5846afee9f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pIhNZOnq'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8669c466-730b-49ec-a9d2-19ab3d9d4b3f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4782ec76-ae1d-42c4-8f59-29a8d0162f88]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:34:54 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:54 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:34:54 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] No VIF found with MAC fa:16:3e:e7:81:89, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-88b97a7e-457b-40c4-8ab4-8179992294a3 tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.232s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --login" returned: 0 in 1.074s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9d090d-b3d0-455b-b967-81188879c4ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc, portal: 172.16.0.220,3260]
Nov 13 20:34:55 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc, portal: 172.16.0.220,3260] successful.
Nov 13 20:34:55 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.utils [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0aab803-a2d0-4df1-9701-d7e3d0f20e0d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21cb043-aa5c-47b9-a6bf-80fc7424ce1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be23dbe1-7343-4cf6-b14a-307309c88a5b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e0ac45-7d1e-4372-831e-48e41c93a8b5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:34:55 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:34:55 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:34:55 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.320s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab93ff0-3751-416e-98d5-fe24a3536345]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[df08553e-d61b-4aac-bbaf-35e1f3ea45ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6705bab5-10aa-4945-8130-f1042a349e73]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIhNZOnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:34:55 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:34:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[62409aef-e2ed-4ebf-8430-b65970094048]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:34:55 user nova-compute[75239]: DEBUG os_brick.utils [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:55 user nova-compute[75239]: INFO nova.compute.manager [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Swapping volume ff71d5c5-9140-4781-9441-4430e66eda16 for 192e890f-f2da-4571-8718-9cbc56d2e244
Nov 13 20:34:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.386s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:34:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] <== connect_volume: return (2990ms) {'type': 'block', 'scsi_wwn': '23137353731343433', 'path': '/dev/sdh'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:34:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137353731343433', 'path': '/dev/sdh'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:34:56 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lazy-loading 'flavor' on Instance uuid 4577b5eb-6acf-4616-931b-28b5ef72d739 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:34:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:34:56 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:34:56 user nova-compute[75239]:   <source dev="/dev/sdh"/>
Nov 13 20:34:56 user nova-compute[75239]:   <target dev="sdc" bus="scsi"/>
Nov 13 20:34:56 user nova-compute[75239]:   <serial>28f66b66-2ead-44be-92d7-404e1d50c2fc</serial>
Nov 13 20:34:56 user nova-compute[75239]:   <address type="drive" controller="0" unit="2"/>
Nov 13 20:34:56 user nova-compute[75239]: </disk>
Nov 13 20:34:56 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:34:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] No BDM found with device name sda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:34:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] No VIF found with MAC fa:16:3e:9a:42:e7, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:34:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7e4bb74f-e884-4156-8a16-34176daf8e42 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.035s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:34:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:34:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:34:58 user nova-compute[75239]: INFO nova.compute.manager [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Detaching volume 28f66b66-2ead-44be-92d7-404e1d50c2fc
Nov 13 20:34:58 user nova-compute[75239]: INFO nova.virt.block_device [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Attempting to driver detach volume 28f66b66-2ead-44be-92d7-404e1d50c2fc from mountpoint /dev/sdc
Nov 13 20:34:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Attempting to detach device sdc from instance 4577b5eb-6acf-4616-931b-28b5ef72d739 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:34:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:34:58 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:34:58 user nova-compute[75239]:   <source dev="/dev/sdh"/>
Nov 13 20:34:58 user nova-compute[75239]:   <target dev="sdc" bus="scsi"/>
Nov 13 20:34:58 user nova-compute[75239]:   <serial>28f66b66-2ead-44be-92d7-404e1d50c2fc</serial>
Nov 13 20:34:58 user nova-compute[75239]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 20:34:58 user nova-compute[75239]: </disk>
Nov 13 20:34:58 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:34:58 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Successfully detached device sdc from instance 4577b5eb-6acf-4616-931b-28b5ef72d739 from the persistent domain config.
Nov 13 20:34:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4577b5eb-6acf-4616-931b-28b5ef72d739 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:34:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:34:58 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:34:58 user nova-compute[75239]:   <source dev="/dev/sdh"/>
Nov 13 20:34:58 user nova-compute[75239]:   <target dev="sdc" bus="scsi"/>
Nov 13 20:34:58 user nova-compute[75239]:   <serial>28f66b66-2ead-44be-92d7-404e1d50c2fc</serial>
Nov 13 20:34:58 user nova-compute[75239]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 20:34:58 user nova-compute[75239]: </disk>
Nov 13 20:34:58 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:34:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4577b5eb-6acf-4616-931b-28b5ef72d739 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:34:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:34:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlnPpbOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03', 'attached_at': '', 'detached_at': '', 'volume_id': '192e890f-f2da-4571-8718-9cbc56d2e244', 'serial': '192e890f-f2da-4571-8718-9cbc56d2e244'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjsBFyzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff71d5c5-9140-4781-9441-4430e66eda16', 'serial'} {{(pid=75239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 20:34:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:34:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlnPpbOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:34:59 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:59 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:34:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:34:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:34:59 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:34:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98c3a0-c253-449d-9e2c-1c919523cb0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:35:00 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23657e5-0f3c-4a16-9ebf-48f64e1fd164]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244] added
Nov 13 20:35:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4aa565a-5902-4766-8aec-ba512bc6dd96]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a783caca-06d4-490f-8c29-0084c79f70e1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlnPpbOZ {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlnPpbOZ" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[30abebd0-1453-4b53-be9a-4d6728420fc6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dlnPpbOZ'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6630d6a-90bb-447d-8bc4-dec6ddf58212]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb37b24-7fdc-44a6-b26a-5b5dad393121]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6e9cd3-cd8f-44d1-9037-5280c8f6f79e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244, portal: 172.16.0.220,3260]
Nov 13 20:35:00 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ada2473-390a-4b45-83ee-2b9b1542a2b9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3ec045-6f16-4a6b-99b1-48ba288e0a66]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:00 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f85772-0df2-41a9-9870-dea98e4fbbd1]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:35:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlnPpbOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:35:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23161643535326232', 'path': '/dev/sdi'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161643535326232', 'path': '/dev/sdi'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:35:01 user nova-compute[75239]: DEBUG nova.objects.instance [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lazy-loading 'flavor' on Instance uuid ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 130023424 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-cd0e8ad4-9c4a-4e0e-bf3b-73578d03b7fe req-0c7bfe86-c4d6-43b4-917e-9afb557ce98b service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received event network-changed-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-cd0e8ad4-9c4a-4e0e-bf3b-73578d03b7fe req-0c7bfe86-c4d6-43b4-917e-9afb557ce98b service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Refreshing instance network info cache due to event network-changed-02e4a5db-35bd-4e10-92de-3a0f4e635ab0. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cd0e8ad4-9c4a-4e0e-bf3b-73578d03b7fe req-0c7bfe86-c4d6-43b4-917e-9afb557ce98b service nova] Acquiring lock "refresh_cache-01d607cc-47f6-4c80-a7f2-3db54c1ce897" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cd0e8ad4-9c4a-4e0e-bf3b-73578d03b7fe req-0c7bfe86-c4d6-43b4-917e-9afb557ce98b service nova] Acquired lock "refresh_cache-01d607cc-47f6-4c80-a7f2-3db54c1ce897" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG nova.network.neutron [req-cd0e8ad4-9c4a-4e0e-bf3b-73578d03b7fe req-0c7bfe86-c4d6-43b4-917e-9afb557ce98b service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Refreshing network info cache for port 02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 491782144 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lazy-loading 'flavor' on Instance uuid 01d607cc-47f6-4c80-a7f2-3db54c1ce897 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:03 user nova-compute[75239]: INFO nova.compute.manager [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Attaching volume b685be2b-e941-4930-9004-a12ec1f3cb0d to /dev/vdb
Nov 13 20:35:03 user nova-compute[75239]: DEBUG nova.network.neutron [req-cd0e8ad4-9c4a-4e0e-bf3b-73578d03b7fe req-0c7bfe86-c4d6-43b4-917e-9afb557ce98b service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Updated VIF entry in instance network info cache for port 02e4a5db-35bd-4e10-92de-3a0f4e635ab0. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG nova.network.neutron [req-cd0e8ad4-9c4a-4e0e-bf3b-73578d03b7fe req-0c7bfe86-c4d6-43b4-917e-9afb557ce98b service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Updating instance_info_cache with network_info: [{"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cd0e8ad4-9c4a-4e0e-bf3b-73578d03b7fe req-0c7bfe86-c4d6-43b4-917e-9afb557ce98b service nova] Releasing lock "refresh_cache-01d607cc-47f6-4c80-a7f2-3db54c1ce897" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG os_brick.utils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1997612-a5a5-411a-af62-ecf72388bc32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff1e7ba-8d91-4bd1-ae56-b6029a9c8781]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5204c46c-a887-492c-850d-135330d59eec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[393013bd-febf-427a-9f44-edf81c9952f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 656408576 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:35:03 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:35:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f882fa-7626-467a-92fd-b4259bca39aa]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG os_brick.utils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:03 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Updating existing volume attachment record: 31ffd168-d6f6-469d-9b07-1cdbadc0b30e {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:35:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 828375040 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 995098624 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjsBFyzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:05 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb536c0-a7a8-4196-aab2-4818db003960]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:35:05 user nova-compute[75239]: No targets found.
Nov 13 20:35:05 user nova-compute[75239]: iSNS:
Nov 13 20:35:05 user nova-compute[75239]: No targets found.
Nov 13 20:35:05 user nova-compute[75239]: STATIC:
Nov 13 20:35:05 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80
Nov 13 20:35:05 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:05 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:05 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:05 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:05 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:05 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389
Nov 13 20:35:05 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:05 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:05 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf
Nov 13 20:35:05 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:05 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:05 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed
Nov 13 20:35:05 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:05 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:05 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc
Nov 13 20:35:05 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:05 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:05 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:35:05 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:05 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:05 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244
Nov 13 20:35:05 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:05 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:05 user nova-compute[75239]: FIRMWARE:
Nov 13 20:35:05 user nova-compute[75239]: No targets found.
Nov 13 20:35:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:35:05 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:35:05 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b583d00-01e4-4096-893f-e53f6af3e6e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dd70a4-679c-493f-a2df-c3f76634f239]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:05 user nova-compute[75239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d84226050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16'): ({'sdg'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Removing single pathed devices sdg {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[515b1c54-8607-4c35-9c9e-8cde4d800bb3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b07cd7c-d53f-4097-a68a-cb96d3bfdf43]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Flushing IO for device /dev/sdg {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.011s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cb1d47-94db-4e35-b5ae-be74df5c1f28]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.059s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea728fe4-96d8-4f7e-ab93-58677499a98a]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ec93b1-62e9-4e98-8fa2-8de2a063df81]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6024566e-37ed-44a7-9020-45b77a9da9cf]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260]
Nov 13 20:35:05 user nova-compute[75239]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c18e9b-88b6-4b31-8c1d-96165b11f553]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] <== disconnect_volume: return (347ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlnPpbOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03', 'attached_at': '', 'detached_at': '', 'volume_id': '192e890f-f2da-4571-8718-9cbc56d2e244', 'serial'} {{(pid=75239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 20:35:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] swap_volume: removing Cinder connection for volume ff71d5c5-9140-4781-9441-4430e66eda16 {{(pid=75239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 20:35:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] swap_volume: Updating volume ff71d5c5-9140-4781-9441-4430e66eda16 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "dlnPpbOZ", "auth_password": "dZgYrvFon2NJ8e", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "192e890f-f2da-4571-8718-9cbc56d2e244"}, "status": "reserved", "instance": "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03", "attached_at": "", "detached_at": "", "volume_id": "192e890f-f2da-4571-8718-9cbc56d2e244", "serial": "192e890f-f2da-4571-8718-9cbc56d2e244"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '192e890f-f2da-4571-8718-9cbc56d2e244', 'no_device': None, 'attachment_id': '27ba2137-3014-4b43-a589-37b7762bf01a'} {{(pid=75239) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 20:35:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-54c67c43-d694-4c5e-b847-2adcf5dcd64e tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 10.899s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.utils [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f603e4c4-dae4-4a4e-8202-7ac07f1825bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14bcb14-4dcb-4a5e-ba59-53a3ad8d9e9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[358e3e45-993c-48bb-9743-a0a47cfa4e88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b84a5d-9c15-499b-bb4c-810d189961e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:35:08 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae40831-0979-418a-a18a-24a0a2a9854a]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.utils [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvIurQfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:08 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:08 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:08 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03333c90-b997-45ad-b542-eab9c98f0552]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:35:08 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[93725699-19ae-4067-8577-21eb59563d04]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d] added
Nov 13 20:35:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: INFO nova.compute.manager [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Swapping volume 192e890f-f2da-4571-8718-9cbc56d2e244 for ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e4294d-c83d-4d8b-b285-740e55b4e7da]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e30f1-5000-4e3b-b2b9-c7e26194080c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvIurQfl {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvIurQfl" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e87821f-9947-4c84-8b18-c3015c11ff9b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvIurQfl'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7544eef-d782-4573-9303-e59a0450d36e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c55b0a-a1cd-4487-8e5b-54f7bd2ce8dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df479e-14fc-4572-85c2-b9c5bf703ecd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d, portal: 172.16.0.220,3260]
Nov 13 20:35:08 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff8ca84-39d6-49ff-bf58-03c40f9fff72]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f53d54-112a-4039-984a-5a73a5dbbf9c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:08 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afc6fdb-379d-40b1-b2c7-3e738df3bae5]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:35:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvIurQfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:35:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23566663065616136', 'path': '/dev/sdg'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566663065616136', 'path': '/dev/sdg'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:35:09 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lazy-loading 'flavor' on Instance uuid 01d607cc-47f6-4c80-a7f2-3db54c1ce897 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] attach device xml: <disk type="block" device="disk">
Nov 13 20:35:09 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:35:09 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:35:09 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:35:09 user nova-compute[75239]:   <serial>b685be2b-e941-4930-9004-a12ec1f3cb0d</serial>
Nov 13 20:35:09 user nova-compute[75239]: </disk>
Nov 13 20:35:09 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:35:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:35:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:35:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] No VIF found with MAC fa:16:3e:99:56:06, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:35:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4198afb0-e1c9-4c82-bc0e-6ed8c84c5457 tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.558s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquiring lock "9373b4cc-900f-4657-8d3c-b9b87746b73b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquiring lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:11 user nova-compute[75239]: INFO nova.compute.manager [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Terminating instance
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.compute.manager [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-8e0e9d91-d630-4a7c-968f-6abf570a3824 req-61456978-1d5b-436d-a77c-3564d67762fa service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received event network-vif-unplugged-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8e0e9d91-d630-4a7c-968f-6abf570a3824 req-61456978-1d5b-436d-a77c-3564d67762fa service nova] Acquiring lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8e0e9d91-d630-4a7c-968f-6abf570a3824 req-61456978-1d5b-436d-a77c-3564d67762fa service nova] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8e0e9d91-d630-4a7c-968f-6abf570a3824 req-61456978-1d5b-436d-a77c-3564d67762fa service nova] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-8e0e9d91-d630-4a7c-968f-6abf570a3824 req-61456978-1d5b-436d-a77c-3564d67762fa service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] No waiting events found dispatching network-vif-unplugged-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-8e0e9d91-d630-4a7c-968f-6abf570a3824 req-61456978-1d5b-436d-a77c-3564d67762fa service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received event network-vif-unplugged-907f2d51-17ac-4fae-ad50-bb5601668a83 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8137a5e8-d281-4fe3-a52a-bb2972efa519 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] volume_snapshot_create: create_info: {'snapshot_id': 'f66e9652-a110-4f14-a917-4bb3520ec7ec', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75239) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8137a5e8-d281-4fe3-a52a-bb2972efa519 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] snap xml: <domainsnapshot>
Nov 13 20:35:11 user nova-compute[75239]:   <disks>
Nov 13 20:35:11 user nova-compute[75239]:     <disk name="/dev/sdg" snapshot="external" type="file">
Nov 13 20:35:11 user nova-compute[75239]:       <source file="/dev/new_file"/>
Nov 13 20:35:11 user nova-compute[75239]:     </disk>
Nov 13 20:35:11 user nova-compute[75239]:     <disk name="vda" snapshot="no"/>
Nov 13 20:35:11 user nova-compute[75239]:   </disks>
Nov 13 20:35:11 user nova-compute[75239]: </domainsnapshot>
Nov 13 20:35:11 user nova-compute[75239]:  {{(pid=75239) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8137a5e8-d281-4fe3-a52a-bb2972efa519 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] Lazy-loading 'system_metadata' on Instance uuid 01d607cc-47f6-4c80-a7f2-3db54c1ce897 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Instance destroyed successfully.
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.objects.instance [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lazy-loading 'resources' on Instance uuid 9373b4cc-900f-4657-8d3c-b9b87746b73b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:33:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-418576512',display_name='tempest-VolumesActionsTest-instance-418576512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-418576512',id=10,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5bb758dca03e46169ddab689f3b297a9',ramdisk_id='',reservation_id='r-x2drnvxj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-133738285',owner_user_name='tempest-VolumesActionsTest-133738285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:33:27Z,user_data=None,user_id='01fcde5e48124323b63299c2d0283099',uuid=9373b4cc-900f-4657-8d3c-b9b87746b73b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Converting VIF {"id": "907f2d51-17ac-4fae-ad50-bb5601668a83", "address": "fa:16:3e:b1:db:67", "network": {"id": "c524e351-a8ca-4e21-8efe-fc4e951da538", "bridge": "br-int", "label": "tempest-VolumesActionsTest-407762525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5bb758dca03e46169ddab689f3b297a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap907f2d51-17", "ovs_interfaceid": "907f2d51-17ac-4fae-ad50-bb5601668a83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:db:67,bridge_name='br-int',has_traffic_filtering=True,id=907f2d51-17ac-4fae-ad50-bb5601668a83,network=Network(c524e351-a8ca-4e21-8efe-fc4e951da538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907f2d51-17') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG os_vif [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:db:67,bridge_name='br-int',has_traffic_filtering=True,id=907f2d51-17ac-4fae-ad50-bb5601668a83,network=Network(c524e351-a8ca-4e21-8efe-fc4e951da538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907f2d51-17') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap907f2d51-17, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f669bd44-5bd1-42d2-aadb-698a88950d66) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b6c93308-5249-4464-ac8e-58426348c1b7 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] volume_snapshot_delete: delete_info: {'volume_id': 'b685be2b-e941-4930-9004-a12ec1f3cb0d'} {{(pid=75239) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [None req-b6c93308-5249-4464-ac8e-58426348c1b7 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     if delete_info['type'] != 'qcow2':
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] KeyError: 'type'
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] 
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8137a5e8-d281-4fe3-a52a-bb2972efa519 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 20:35:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:11 user nova-compute[75239]: INFO os_vif [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:db:67,bridge_name='br-int',has_traffic_filtering=True,id=907f2d51-17ac-4fae-ad50-bb5601668a83,network=Network(c524e351-a8ca-4e21-8efe-fc4e951da538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap907f2d51-17')
Nov 13 20:35:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Deleting instance files /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b_del
Nov 13 20:35:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Deletion of /opt/stack/data/nova/instances/9373b4cc-900f-4657-8d3c-b9b87746b73b_del complete
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [None req-8137a5e8-d281-4fe3-a52a-bb2972efa519 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     rv = execute(f, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     six.reraise(c, e, tb)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     raise value
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     rv = meth(*args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [None req-8137a5e8-d281-4fe3-a52a-bb2972efa519 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     self._volume_snapshot_create(context, instance, guest,
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     rv = execute(f, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     six.reraise(c, e, tb)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     raise value
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     rv = meth(*args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [None req-b6c93308-5249-4464-ac8e-58426348c1b7 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-421911cf-50fb-445b-9145-0d90a7b41a38)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server [None req-b6c93308-5249-4464-ac8e-58426348c1b7 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] Exception during message handling: KeyError: 'type'
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver [None req-8137a5e8-d281-4fe3-a52a-bb2972efa519 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f66e9652-a110-4f14-a917-4bb3520ec7ec could not be found.
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     raise value
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f66e9652-a110-4f14-a917-4bb3520ec7ec could not be found. (HTTP 404) (Request-ID: req-068588dc-f1f7-49a8-a71c-c3385fbe189f)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f66e9652-a110-4f14-a917-4bb3520ec7ec could not be found.
Nov 13 20:35:11 user nova-compute[75239]: ERROR nova.virt.libvirt.driver 
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server [None req-8137a5e8-d281-4fe3-a52a-bb2972efa519 tempest-VolumesAssistedSnapshotsTest-317460493 tempest-VolumesAssistedSnapshotsTest-317460493-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     raise value
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 20:35:11 user nova-compute[75239]: ERROR oslo_messaging.rpc.server 
Nov 13 20:35:11 user nova-compute[75239]: INFO nova.compute.manager [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 13 20:35:11 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:35:11 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:12 user nova-compute[75239]: INFO nova.compute.manager [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Detaching volume b685be2b-e941-4930-9004-a12ec1f3cb0d
Nov 13 20:35:12 user nova-compute[75239]: INFO nova.virt.block_device [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Attempting to driver detach volume b685be2b-e941-4930-9004-a12ec1f3cb0d from mountpoint /dev/vdb
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Attempting to detach device vdb from instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 20:35:12 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:35:12 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:35:12 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:35:12 user nova-compute[75239]:   <serial>b685be2b-e941-4930-9004-a12ec1f3cb0d</serial>
Nov 13 20:35:12 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:35:12 user nova-compute[75239]: </disk>
Nov 13 20:35:12 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:35:12 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Successfully detached device vdb from instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897 from the persistent domain config.
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 20:35:12 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:35:12 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:35:12 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:35:12 user nova-compute[75239]:   <serial>b685be2b-e941-4930-9004-a12ec1f3cb0d</serial>
Nov 13 20:35:12 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:35:12 user nova-compute[75239]: </disk>
Nov 13 20:35:12 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:12 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Took 0.41 seconds to deallocate network for instance.
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjsBFyzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff71d5c5-9140-4781-9441-4430e66eda16', 'serial': 'ff71d5c5-9140-4781-9441-4430e66eda16'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlnPpbOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '192e890f-f2da-4571-8718-9cbc56d2e244'}, 'status': 'reserved', 'instance': 'ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03', 'attached_at': '', 'detached_at': '', 'volume_id': '192e890f-f2da-4571-8718-9cbc56d2e244', 'serial'} {{(pid=75239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjsBFyzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:12 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:12 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:12 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fc82fc-2b3d-480a-a319-21dd0a63d574]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:35:12 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[582da73f-f7f1-4d0f-bb53-3b56543b94a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16] added
Nov 13 20:35:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:12 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ae8531d9-3930-4373-91b2-628d850e8ba7 is timed out.
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Successfully detached device vdb from instance ae8531d9-3930-4373-91b2-628d850e8ba7 from the live domain config.
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmyhBfHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:12 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be780cb8-001c-4b39-96d2-6c98ac32d443]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaaf909-c4c7-44fa-ad78-fe977bbb2bb0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjsBFyzm {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fjsBFyzm" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1367cfc9-3957-4c44-9600-899c00ddd6b2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fjsBFyzm'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9f565e-2a1a-46af-8847-924329d6682f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b16734-f1d6-4f8a-8e9c-3ecb08376992]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb6be69-d7e1-42d6-ab46-e2c8b34070b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260]
Nov 13 20:35:12 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60106198-be5e-49eb-a810-38c4d20206e4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Deleted allocations for instance 9373b4cc-900f-4657-8d3c-b9b87746b73b
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b531802-5f44-460f-9b10-4907426c3680]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:12 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dd58e0-6887-40aa-aa87-fea96099a5f6]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:35:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjsBFyzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-903c1e40-22b2-48e6-86a2-5df86218dd51 tempest-VolumesActionsTest-133738285 tempest-VolumesActionsTest-133738285-project-member] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-95e664ca-c1da-4578-b736-f3cc47dfe63d req-53a3060c-e696-490a-805f-96e2bf17c00c service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received event network-vif-plugged-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95e664ca-c1da-4578-b736-f3cc47dfe63d req-53a3060c-e696-490a-805f-96e2bf17c00c service nova] Acquiring lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95e664ca-c1da-4578-b736-f3cc47dfe63d req-53a3060c-e696-490a-805f-96e2bf17c00c service nova] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95e664ca-c1da-4578-b736-f3cc47dfe63d req-53a3060c-e696-490a-805f-96e2bf17c00c service nova] Lock "9373b4cc-900f-4657-8d3c-b9b87746b73b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-95e664ca-c1da-4578-b736-f3cc47dfe63d req-53a3060c-e696-490a-805f-96e2bf17c00c service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] No waiting events found dispatching network-vif-plugged-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:13 user nova-compute[75239]: WARNING nova.compute.manager [req-95e664ca-c1da-4578-b736-f3cc47dfe63d req-53a3060c-e696-490a-805f-96e2bf17c00c service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received unexpected event network-vif-plugged-907f2d51-17ac-4fae-ad50-bb5601668a83 for instance with vm_state deleted and task_state None.
Nov 13 20:35:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-95e664ca-c1da-4578-b736-f3cc47dfe63d req-53a3060c-e696-490a-805f-96e2bf17c00c service nova] [instance: 9373b4cc-900f-4657-8d3c-b9b87746b73b] Received event network-vif-deleted-907f2d51-17ac-4fae-ad50-bb5601668a83 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23863393162313563', 'path': '/dev/sdj'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863393162313563', 'path': '/dev/sdj'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.309s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lazy-loading 'flavor' on Instance uuid ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[377e9268-40db-4817-b5db-84265b38d21b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:35:13 user nova-compute[75239]: No targets found.
Nov 13 20:35:13 user nova-compute[75239]: iSNS:
Nov 13 20:35:13 user nova-compute[75239]: No targets found.
Nov 13 20:35:13 user nova-compute[75239]: STATIC:
Nov 13 20:35:13 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d
Nov 13 20:35:13 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:13 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:13 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80
Nov 13 20:35:13 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:13 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:13 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:13 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:13 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:13 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389
Nov 13 20:35:13 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:13 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:13 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf
Nov 13 20:35:13 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:13 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:13 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed
Nov 13 20:35:13 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:13 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:13 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc
Nov 13 20:35:13 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:13 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:13 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:35:13 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:13 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:13 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244
Nov 13 20:35:13 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:13 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:13 user nova-compute[75239]: FIRMWARE:
Nov 13 20:35:13 user nova-compute[75239]: No targets found.
Nov 13 20:35:13 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:35:13 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:35:13 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[516df90c-5535-4c01-8a65-020227df410f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c35856-24dd-4fcf-89f4-26d258af3af1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:14 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:14 user nova-compute[75239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed (non-flash)
Nov 13 20:35:14 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d6050fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed'): ({'sdf'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Removing single pathed devices sdf {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[04315af0-4742-421c-8441-05e0cd288fe6]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1dfb2e-a7bc-41b6-9b15-eaf3b4238e92]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Flushing IO for device /dev/sdf {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf89920-e23f-45cd-961a-78bcc567cf9d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2666378-f84f-4073-9bef-418f29b16504]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] SCSI volumes sdf have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6873da-60da-4634-bb86-a5c1b9bf9535]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c40a22-434a-4b1c-af44-9c9cf59d78f8]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed, portal: 172.16.0.220,3260]
Nov 13 20:35:14 user nova-compute[75239]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:14 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:20b2e8a4-8017-44ee-a233-956dc3a3d7ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca8bcc-0b9a-44f0-9bd9-14d4842823d7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] <== disconnect_volume: return (1659ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 89128960 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:15 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lazy-loading 'flavor' on Instance uuid ae8531d9-3930-4373-91b2-628d850e8ba7 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 257949696 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d7093874-66ef-4b1b-8d2a-fa0596579c0b tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.344s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 433061888 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 589299712 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 766509056 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 918552576 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlnPpbOZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '192e890f-f2da-4571-8718-9cbc56d2e244'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6371c4c7-1af1-4079-a3df-f52f47d5f5ec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:35:18 user nova-compute[75239]: No targets found.
Nov 13 20:35:18 user nova-compute[75239]: iSNS:
Nov 13 20:35:18 user nova-compute[75239]: No targets found.
Nov 13 20:35:18 user nova-compute[75239]: STATIC:
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: FIRMWARE:
Nov 13 20:35:18 user nova-compute[75239]: No targets found.
Nov 13 20:35:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:35:18 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:35:18 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16baa33-0385-49c4-8274-6d32fb325fe8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91913b3-dab4-43b0-a5b6-7d051d752b27]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60593d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244'): ({'sdi'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Removing single pathed devices sdi {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[476db518-60a9-4062-b506-6180b942a1df]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d70195-889b-40e5-8287-706f587242da]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Flushing IO for device /dev/sdi {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc019cdc-55be-4607-9c45-4959c97719dd]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.039s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aa6976-f97f-408c-b1f3-01ddd56c207a]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] SCSI volumes sdi have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fe5831-c622-461a-9bbf-10cbae6f80db]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa173208-f3a7-4857-8d09-db7adf052e05]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244, portal: 172.16.0.220,3260]
Nov 13 20:35:18 user nova-compute[75239]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:192e890f-f2da-4571-8718-9cbc56d2e244 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e89b4-0c6e-4f67-bd05-cc3b8eafdcb4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] <== disconnect_volume: return (317ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjsBFyzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff71d5c5-9140-4781-9441-4430e66eda16', 'serial'} {{(pid=75239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] swap_volume: removing Cinder connection for volume 192e890f-f2da-4571-8718-9cbc56d2e244 {{(pid=75239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 20:35:18 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 4577b5eb-6acf-4616-931b-28b5ef72d739 is timed out.
Nov 13 20:35:18 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Successfully detached device sdc from instance 4577b5eb-6acf-4616-931b-28b5ef72d739 from the live domain config.
Nov 13 20:35:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pIhNZOnq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb117905-1bba-4db9-b825-883822fe9514]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:35:18 user nova-compute[75239]: No targets found.
Nov 13 20:35:18 user nova-compute[75239]: iSNS:
Nov 13 20:35:18 user nova-compute[75239]: No targets found.
Nov 13 20:35:18 user nova-compute[75239]: STATIC:
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:35:18 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:18 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:18 user nova-compute[75239]: FIRMWARE:
Nov 13 20:35:18 user nova-compute[75239]: No targets found.
Nov 13 20:35:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:35:18 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:35:18 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5ae063-4d8f-4aa3-bbb9-6f4b98dca39b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[687010ac-2f56-4694-b878-7223ed2675fc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8424e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc'): ({'sdh'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Removing single pathed devices sdh {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc400f72-1147-4d0b-b55e-c032657732c5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ae31a7-195a-4c76-a8d7-d6239d426142]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Flushing IO for device /dev/sdh {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[607daf7f-3eb0-4beb-b781-7f4a199400e3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80b5686-9e7c-4190-a774-cd24d2813d87]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] SCSI volumes sdh have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[766c25fc-b5cf-4a75-83d5-c66bae36871e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dd118e-1931-4980-af71-33c252705f8b]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc, portal: 172.16.0.220,3260]
Nov 13 20:35:19 user nova-compute[75239]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:28f66b66-2ead-44be-92d7-404e1d50c2fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2fe509-373d-4278-abe3-3a033e045b82]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] <== disconnect_volume: return (335ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] swap_volume: Updating volume 192e890f-f2da-4571-8718-9cbc56d2e244 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "fjsBFyzm", "auth_password": "4R3ws0TSNL1OUg", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "ff71d5c5-9140-4781-9441-4430e66eda16"}, "status": "reserved", "instance": "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03", "attached_at": "", "detached_at": "", "volume_id": "ff71d5c5-9140-4781-9441-4430e66eda16", "serial": "ff71d5c5-9140-4781-9441-4430e66eda16"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ff71d5c5-9140-4781-9441-4430e66eda16', 'no_device': None, 'attachment_id': 'ae7e2da8-2701-40cc-bda4-70c2fe5e1d95'} {{(pid=75239) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 20:35:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d1e57b6e-d693-4a26-81b0-000b66227c85 tempest-TestVolumeSwap-1429578329 tempest-TestVolumeSwap-1429578329-project-admin] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.341s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG nova.objects.instance [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lazy-loading 'flavor' on Instance uuid 4577b5eb-6acf-4616-931b-28b5ef72d739 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aa4cd85c-1e90-467a-9ef2-cf03501c7a37 tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.665s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-de667a5f-f3ac-45b7-b967-97c3bad2bae1 req-94e6be1b-4411-43ab-bb06-a308089dd0e6 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-changed-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-de667a5f-f3ac-45b7-b967-97c3bad2bae1 req-94e6be1b-4411-43ab-bb06-a308089dd0e6 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing instance network info cache due to event network-changed-5b3076cd-3c9c-4261-9361-c18fb53f1a38. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-de667a5f-f3ac-45b7-b967-97c3bad2bae1 req-94e6be1b-4411-43ab-bb06-a308089dd0e6 service nova] Acquiring lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-de667a5f-f3ac-45b7-b967-97c3bad2bae1 req-94e6be1b-4411-43ab-bb06-a308089dd0e6 service nova] Acquired lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG nova.network.neutron [req-de667a5f-f3ac-45b7-b967-97c3bad2bae1 req-94e6be1b-4411-43ab-bb06-a308089dd0e6 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Refreshing network info cache for port 5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:20 user nova-compute[75239]: INFO nova.compute.manager [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Detaching volume ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:20 user nova-compute[75239]: INFO nova.virt.block_device [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Attempting to driver detach volume ff71d5c5-9140-4781-9441-4430e66eda16 from mountpoint /dev/vdb
Nov 13 20:35:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Attempting to detach device vdb from instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:35:20 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:35:20 user nova-compute[75239]:   <source dev="/dev/sdj"/>
Nov 13 20:35:20 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:35:20 user nova-compute[75239]:   <serial>ff71d5c5-9140-4781-9441-4430e66eda16</serial>
Nov 13 20:35:20 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:35:20 user nova-compute[75239]: </disk>
Nov 13 20:35:20 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:20 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Successfully detached device vdb from instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 from the persistent domain config.
Nov 13 20:35:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:35:20 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:35:20 user nova-compute[75239]:   <source dev="/dev/sdj"/>
Nov 13 20:35:20 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:35:20 user nova-compute[75239]:   <serial>ff71d5c5-9140-4781-9441-4430e66eda16</serial>
Nov 13 20:35:20 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:35:20 user nova-compute[75239]: </disk>
Nov 13 20:35:20 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:35:20 user nova-compute[75239]: INFO nova.compute.manager [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Terminating instance
Nov 13 20:35:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.network.neutron [req-de667a5f-f3ac-45b7-b967-97c3bad2bae1 req-94e6be1b-4411-43ab-bb06-a308089dd0e6 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updated VIF entry in instance network info cache for port 5b3076cd-3c9c-4261-9361-c18fb53f1a38. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.network.neutron [req-de667a5f-f3ac-45b7-b967-97c3bad2bae1 req-94e6be1b-4411-43ab-bb06-a308089dd0e6 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [{"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-de667a5f-f3ac-45b7-b967-97c3bad2bae1 req-94e6be1b-4411-43ab-bb06-a308089dd0e6 service nova] Releasing lock "refresh_cache-927720cf-b009-4f9d-8e54-1b5cd3788e99" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-a4eed727-c8a8-4795-9ca2-4ee85b2902f0 req-7b4b837a-6cc4-4886-9237-8808591bf012 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received event network-vif-unplugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a4eed727-c8a8-4795-9ca2-4ee85b2902f0 req-7b4b837a-6cc4-4886-9237-8808591bf012 service nova] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a4eed727-c8a8-4795-9ca2-4ee85b2902f0 req-7b4b837a-6cc4-4886-9237-8808591bf012 service nova] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a4eed727-c8a8-4795-9ca2-4ee85b2902f0 req-7b4b837a-6cc4-4886-9237-8808591bf012 service nova] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-a4eed727-c8a8-4795-9ca2-4ee85b2902f0 req-7b4b837a-6cc4-4886-9237-8808591bf012 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] No waiting events found dispatching network-vif-unplugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-a4eed727-c8a8-4795-9ca2-4ee85b2902f0 req-7b4b837a-6cc4-4886-9237-8808591bf012 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received event network-vif-unplugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:35:21 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Instance destroyed successfully.
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.objects.instance [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lazy-loading 'resources' on Instance uuid 4577b5eb-6acf-4616-931b-28b5ef72d739 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2124856528',display_name='tempest-AttachSCSIVolumeTestJSON-server-2124856528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2124856528',id=7,image_ref='7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZphExKZl6gh5qPUnu8di50lFhI3WWQLNHlBXKBGEl/L7r0dgQaeGlDbm3hHPjbDSQuFJIFqikJPa/B9gZjUutk7tzxjYdpLatmUjIwU5O4lbiAYA50m6VzH+TSstPbSg==',key_name='tempest-keypair-1516787880',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b650b217c2f5436baeefc322494c2a76',ramdisk_id='',reservation_id='r-n70g0sdi',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='7b3ca7dd-24dc-4cf2-806b-f6f65a04e3a7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-118785139',owner_user_name='tempest-AttachSCSIVolumeTestJSON-118785139-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4d5dd64dc1e441a39dab812acb9aebc3',uuid=4577b5eb-6acf-4616-931b-28b5ef72d739,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Converting VIF {"id": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "address": "fa:16:3e:9a:42:e7", "network": {"id": "4371c00a-d55d-4642-842e-8c8b60c626fb", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-876615368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b650b217c2f5436baeefc322494c2a76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cbf4711-14", "ovs_interfaceid": "4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:42:e7,bridge_name='br-int',has_traffic_filtering=True,id=4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea,network=Network(4371c00a-d55d-4642-842e-8c8b60c626fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbf4711-14') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG os_vif [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:42:e7,bridge_name='br-int',has_traffic_filtering=True,id=4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea,network=Network(4371c00a-d55d-4642-842e-8c8b60c626fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbf4711-14') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cbf4711-14, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f92b7e78-70b5-433d-be3c-38761694a743) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:21 user nova-compute[75239]: INFO os_vif [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:42:e7,bridge_name='br-int',has_traffic_filtering=True,id=4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea,network=Network(4371c00a-d55d-4642-842e-8c8b60c626fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cbf4711-14')
Nov 13 20:35:21 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Deleting instance files /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739_del
Nov 13 20:35:21 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Deletion of /opt/stack/data/nova/instances/4577b5eb-6acf-4616-931b-28b5ef72d739_del complete
Nov 13 20:35:21 user nova-compute[75239]: INFO nova.compute.manager [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 13 20:35:21 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:35:21 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:22 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Took 0.71 seconds to deallocate network for instance.
Nov 13 20:35:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-8c22fee8-1754-433e-88bd-264049058742 req-1fe74d20-a6ca-405a-9947-9be78b021853 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received event network-vif-deleted-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:22 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Deleted allocations for instance 4577b5eb-6acf-4616-931b-28b5ef72d739
Nov 13 20:35:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-054d34cf-1fad-49ee-8c77-2a69f455ed4b tempest-AttachSCSIVolumeTestJSON-118785139 tempest-AttachSCSIVolumeTestJSON-118785139-project-member] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:23 user nova-compute[75239]: INFO nova.compute.manager [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Terminating instance
Nov 13 20:35:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-1a86db75-311f-4816-a62a-377eb9ed1788 req-efaf8569-1994-46bf-bf28-e07690fbf8a6 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received event network-vif-plugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a86db75-311f-4816-a62a-377eb9ed1788 req-efaf8569-1994-46bf-bf28-e07690fbf8a6 service nova] Acquiring lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a86db75-311f-4816-a62a-377eb9ed1788 req-efaf8569-1994-46bf-bf28-e07690fbf8a6 service nova] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a86db75-311f-4816-a62a-377eb9ed1788 req-efaf8569-1994-46bf-bf28-e07690fbf8a6 service nova] Lock "4577b5eb-6acf-4616-931b-28b5ef72d739-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-1a86db75-311f-4816-a62a-377eb9ed1788 req-efaf8569-1994-46bf-bf28-e07690fbf8a6 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] No waiting events found dispatching network-vif-plugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:23 user nova-compute[75239]: WARNING nova.compute.manager [req-1a86db75-311f-4816-a62a-377eb9ed1788 req-efaf8569-1994-46bf-bf28-e07690fbf8a6 service nova] [instance: 4577b5eb-6acf-4616-931b-28b5ef72d739] Received unexpected event network-vif-plugged-4cbf4711-146e-4ca3-8e2b-b42c5d7c70ea for instance with vm_state deleted and task_state None.
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-7f39ba2e-e5e9-42f1-8e38-b5bbee68293b req-8bc763ae-25ed-41db-90e1-4e8c28590c55 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7f39ba2e-e5e9-42f1-8e38-b5bbee68293b req-8bc763ae-25ed-41db-90e1-4e8c28590c55 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7f39ba2e-e5e9-42f1-8e38-b5bbee68293b req-8bc763ae-25ed-41db-90e1-4e8c28590c55 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7f39ba2e-e5e9-42f1-8e38-b5bbee68293b req-8bc763ae-25ed-41db-90e1-4e8c28590c55 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-7f39ba2e-e5e9-42f1-8e38-b5bbee68293b req-8bc763ae-25ed-41db-90e1-4e8c28590c55 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-unplugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-7f39ba2e-e5e9-42f1-8e38-b5bbee68293b req-8bc763ae-25ed-41db-90e1-4e8c28590c55 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-unplugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:24 user nova-compute[75239]: WARNING nova.compute.manager [req-6677de77-b8c1-4597-ab19-33863679cd8c req-05e535db-aa1f-4963-94c4-0f9ed6cb6879 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-80ebe795-140c-43d3-a071-f9b0ce708bd8 for instance with vm_state active and task_state deleting.
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Instance destroyed successfully.
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lazy-loading 'resources' on Instance uuid 927720cf-b009-4f9d-8e54-1b5cd3788e99 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:7c:4f,bridge_name='br-int',has_traffic_filtering=True,id=5b3076cd-3c9c-4261-9361-c18fb53f1a38,network=Network(000df844-a6fb-4c88-b39f-2adbfe4693af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3076cd-3c') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:7c:4f,bridge_name='br-int',has_traffic_filtering=True,id=5b3076cd-3c9c-4261-9361-c18fb53f1a38,network=Network(000df844-a6fb-4c88-b39f-2adbfe4693af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3076cd-3c') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b3076cd-3c, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbac6175-0175-4bb8-b2e0-9986347ce184) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: INFO os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:7c:4f,bridge_name='br-int',has_traffic_filtering=True,id=5b3076cd-3c9c-4261-9361-c18fb53f1a38,network=Network(000df844-a6fb-4c88-b39f-2adbfe4693af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b3076cd-3c')
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:af,bridge_name='br-int',has_traffic_filtering=True,id=96cbdec2-4706-42b7-aaa4-5eeabd622a4e,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96cbdec2-47') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:af,bridge_name='br-int',has_traffic_filtering=True,id=96cbdec2-4706-42b7-aaa4-5eeabd622a4e,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96cbdec2-47') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96cbdec2-47, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d51599a3-20e2-4e71-b638-11bf3415b1da) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: INFO os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:d8:af,bridge_name='br-int',has_traffic_filtering=True,id=96cbdec2-4706-42b7-aaa4-5eeabd622a4e,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap96cbdec2-47')
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=74b0eca2-dc64-4486-8194-83f22572f6af,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74b0eca2-dc') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=74b0eca2-dc64-4486-8194-83f22572f6af,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74b0eca2-dc') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74b0eca2-dc, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=251f98bd-dfe7-4564-a753-49a5c9910b50) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: INFO os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:97:c3,bridge_name='br-int',has_traffic_filtering=True,id=74b0eca2-dc64-4486-8194-83f22572f6af,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap74b0eca2-dc')
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:64,bridge_name='br-int',has_traffic_filtering=True,id=80ebe795-140c-43d3-a071-f9b0ce708bd8,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ebe795-14') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:64,bridge_name='br-int',has_traffic_filtering=True,id=80ebe795-140c-43d3-a071-f9b0ce708bd8,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ebe795-14') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80ebe795-14, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=705617ae-1bc6-435f-820b-5202bb248d09) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: INFO os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:77:64,bridge_name='br-int',has_traffic_filtering=True,id=80ebe795-140c-43d3-a071-f9b0ce708bd8,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80ebe795-14')
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:68:49,bridge_name='br-int',has_traffic_filtering=True,id=6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fcd02c3-9f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:68:49,bridge_name='br-int',has_traffic_filtering=True,id=6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fcd02c3-9f') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fcd02c3-9f, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e3b5cab-1227-4679-b40f-e7afc9260fa0) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: INFO os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:68:49,bridge_name='br-int',has_traffic_filtering=True,id=6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1,network=Network(5469b692-3a35-472e-afe4-fd7e9cc96d9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fcd02c3-9f')
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:61,bridge_name='br-int',has_traffic_filtering=True,id=416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe38c-01') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:61,bridge_name='br-int',has_traffic_filtering=True,id=416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe38c-01') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap416fe38c-01, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3316125c-f7ca-4b80-868b-1e9a4c5c9bb5) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: INFO os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:e0:61,bridge_name='br-int',has_traffic_filtering=True,id=416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416fe38c-01')
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:33:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2123973480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2123973480',id=11,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMw/eI9QWCMkjH8OGTXhbc6/H0HH6Agc/dIewCKMYxw3D7bArDtOfYhzbJsOLPArra/OcmEt80G65AVVgsbFsBOSYiyUvlLy59QI0Hze0Kt5wvo4Z/kL1aMdUkuOgdJrAA==',key_name='tempest-keypair-80262152',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9ba6493d9174244bc27bacaec40b580',ramdisk_id='',reservation_id='r-clvdwtwo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1300668237',owner_user_name='tempest-TaggedBootDevicesTest-1300668237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60384062463c4ab19832ee523767f4e8',uuid=927720cf-b009-4f9d-8e54-1b5cd3788e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converting VIF {"id": "29916a60-1b87-4742-abee-1048131017b8", "address": "fa:16:3e:c1:c7:8b", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29916a60-1b", "ovs_interfaceid": "29916a60-1b87-4742-abee-1048131017b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:8b,bridge_name='br-int',has_traffic_filtering=True,id=29916a60-1b87-4742-abee-1048131017b8,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29916a60-1b') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:8b,bridge_name='br-int',has_traffic_filtering=True,id=29916a60-1b87-4742-abee-1048131017b8,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29916a60-1b') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-unplugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: WARNING nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-5b3076cd-3c9c-4261-9361-c18fb53f1a38 for instance with vm_state active and task_state deleting.
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-unplugged-74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-74b0eca2-dc64-4486-8194-83f22572f6af for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-74b0eca2-dc64-4486-8194-83f22572f6af {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: WARNING nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-74b0eca2-dc64-4486-8194-83f22572f6af for instance with vm_state active and task_state deleting.
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-unplugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: WARNING nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 for instance with vm_state active and task_state deleting.
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-unplugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: WARNING nova.compute.manager [req-3de04ef8-998e-4fd4-b440-f2b5db50f13a req-68806b8d-69c4-4e6d-8070-4ce0168d6569 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea for instance with vm_state active and task_state deleting.
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29916a60-1b, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cb79b79-5140-43dd-a2ae-7c1213195118) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:25 user nova-compute[75239]: INFO os_vif [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:8b,bridge_name='br-int',has_traffic_filtering=True,id=29916a60-1b87-4742-abee-1048131017b8,network=Network(05703ecd-a3aa-4a50-af98-d082949e2e3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29916a60-1b')
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'elnxJwKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:25 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: WARNING nova.compute.manager [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-96cbdec2-4706-42b7-aaa4-5eeabd622a4e for instance with vm_state active and task_state deleting.
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-unplugged-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-unplugged-29916a60-1b87-4742-abee-1048131017b8 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-plugged-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] Acquiring lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] No waiting events found dispatching network-vif-plugged-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:25 user nova-compute[75239]: WARNING nova.compute.manager [req-2a669abf-2438-4477-bc6a-f6471509faab req-3dbf3a96-4f65-48f5-94e0-bb748ef6bd08 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received unexpected event network-vif-plugged-29916a60-1b87-4742-abee-1048131017b8 for instance with vm_state active and task_state deleting.
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49fae6c-0fce-417c-8788-88eb8b2d6595]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:35:25 user nova-compute[75239]: No targets found.
Nov 13 20:35:25 user nova-compute[75239]: iSNS:
Nov 13 20:35:25 user nova-compute[75239]: No targets found.
Nov 13 20:35:25 user nova-compute[75239]: STATIC:
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: FIRMWARE:
Nov 13 20:35:25 user nova-compute[75239]: No targets found.
Nov 13 20:35:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:35:25 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:35:25 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6934b3ed-eb7e-4e98-9a35-fd1743caac85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ea507-b5e7-425f-bce3-3aecb9b4aaa4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:25 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605964d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc62e0e-1efa-4e3c-835e-f30453dd83d7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[21424665-c889-44e2-9b92-814ecffb6ca7]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a45af7-ed6f-458c-86b9-5afcb39ca209]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7577145d-3070-4fe6-8e1e-d7106efc48c8]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[292a175f-964e-40cb-9d03-076db57f96ce]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1a02b0-cde3-4857-a9fa-b0df3c932c61]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389, portal: 172.16.0.220,3260]
Nov 13 20:35:25 user nova-compute[75239]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb9b6eaf-a319-41f0-832c-45b27222a389 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceb5208-f64c-4c8d-a0a2-1779f1a240d0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] <== disconnect_volume: return (366ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'joWGnYRd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:25 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1bc063-4ae7-4074-bc7f-ec782da74a2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:35:25 user nova-compute[75239]: No targets found.
Nov 13 20:35:25 user nova-compute[75239]: iSNS:
Nov 13 20:35:25 user nova-compute[75239]: No targets found.
Nov 13 20:35:25 user nova-compute[75239]: STATIC:
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:35:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:25 user nova-compute[75239]: FIRMWARE:
Nov 13 20:35:25 user nova-compute[75239]: No targets found.
Nov 13 20:35:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:35:25 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:35:25 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[19384e29-6e53-4a34-8d70-cad39c32b0f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3866ea12-a6bc-453f-b042-c7c619e24646]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8428b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[59172901-bb22-465c-a662-4f8f22de01d7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a327f6-7a05-4459-968f-6bbb2e50fd64]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[96153b18-7f82-47a2-957e-c5601c6993db]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fe89eb-68f6-4355-a60c-5c137a609c78]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888b00d-b022-48b0-9373-21e4ab501196]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[128f0fb9-8388-40b3-bae0-5634881b254b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf, portal: 172.16.0.220,3260]
Nov 13 20:35:26 user nova-compute[75239]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99047d9-b258-4356-976e-d5ebd844aecf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6de2a5-e19f-4521-809a-41974e128162]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] <== disconnect_volume: return (359ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OpYQxAiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:26 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1981b666-deb1-4f1c-8e80-8f2fc086e5e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:35:26 user nova-compute[75239]: No targets found.
Nov 13 20:35:26 user nova-compute[75239]: iSNS:
Nov 13 20:35:26 user nova-compute[75239]: No targets found.
Nov 13 20:35:26 user nova-compute[75239]: STATIC:
Nov 13 20:35:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d
Nov 13 20:35:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80
Nov 13 20:35:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:35:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:26 user nova-compute[75239]: FIRMWARE:
Nov 13 20:35:26 user nova-compute[75239]: No targets found.
Nov 13 20:35:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:35:26 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:35:26 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabdf905-ea16-40d6-bf6a-d25f7ec1e04e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c403a104-a091-43a6-b301-f2f1596c3f1f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8428b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80'): ({'sdd'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Removing single pathed devices sdd {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c638fe7-2f50-4611-8c1b-792dbcd5dba8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d44212-11dc-4ebd-87ab-c1948436e482]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Flushing IO for device /dev/sdd {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5130bf89-7346-43c0-a38b-7297021a89cb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5000eb54-4243-4b21-8eee-9e86efd1357f]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b7b2de-4652-4724-abc4-7d655ca8cf63]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e345154-5164-4c85-ad06-bbac435c5978]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80, portal: 172.16.0.220,3260]
Nov 13 20:35:26 user nova-compute[75239]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c5c4cd-42e5-481c-83d6-fc9641554b80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f6d5a6-5665-4828-97d3-b5805609d725]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] <== disconnect_volume: return (350ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:35:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Deleting instance files /opt/stack/data/nova/instances/927720cf-b009-4f9d-8e54-1b5cd3788e99_del
Nov 13 20:35:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Deletion of /opt/stack/data/nova/instances/927720cf-b009-4f9d-8e54-1b5cd3788e99_del complete
Nov 13 20:35:26 user nova-compute[75239]: INFO nova.compute.manager [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Took 3.68 seconds to destroy the instance on the hypervisor.
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json" returned: 0 in 0.361s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid '927720cf-b009-4f9d-8e54-1b5cd3788e99' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid '927720cf-b009-4f9d-8e54-1b5cd3788e99' (instance-0000000b)
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-be68d070-21d4-4986-b94e-7e65ad58c24a req-2534cc5d-8a2f-4a70-81b1-beb24532b178 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-deleted-29916a60-1b87-4742-abee-1048131017b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:28 user nova-compute[75239]: INFO nova.compute.manager [req-be68d070-21d4-4986-b94e-7e65ad58c24a req-2534cc5d-8a2f-4a70-81b1-beb24532b178 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Neutron deleted interface 29916a60-1b87-4742-abee-1048131017b8; detaching it from the instance and deleting it from the info cache
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-be68d070-21d4-4986-b94e-7e65ad58c24a req-2534cc5d-8a2f-4a70-81b1-beb24532b178 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [{"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "address": "fa:16:3e:8b:e0:61", "network": {"id": "05703ecd-a3aa-4a50-af98-d082949e2e3f", "bridge": "br-int", "label": "tempest-device-tagging-net2-34447403", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap416fe38c-01", "ovs_interfaceid": "416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:35:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7888MB free_disk=25.321990966796875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-be68d070-21d4-4986-b94e-7e65ad58c24a req-2534cc5d-8a2f-4a70-81b1-beb24532b178 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Detach interface failed, port_id=29916a60-1b87-4742-abee-1048131017b8, reason: Instance 927720cf-b009-4f9d-8e54-1b5cd3788e99 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d67fcb6b-fb37-4d04-8dab-d74370f76981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ae8531d9-3930-4373-91b2-628d850e8ba7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 927720cf-b009-4f9d-8e54-1b5cd3788e99 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:35:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:35:29 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:35:29 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:35:29 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:35:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.393s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-deleted-416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:30 user nova-compute[75239]: INFO nova.compute.manager [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Neutron deleted interface 416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea; detaching it from the instance and deleting it from the info cache
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [{"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "address": "fa:16:3e:54:77:64", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80ebe795-14", "ovs_interfaceid": "80ebe795-140c-43d3-a071-f9b0ce708bd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Detach interface failed, port_id=416fe38c-01ee-4e12-b5a2-9f0a84e5f7ea, reason: Instance 927720cf-b009-4f9d-8e54-1b5cd3788e99 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-deleted-80ebe795-140c-43d3-a071-f9b0ce708bd8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:30 user nova-compute[75239]: INFO nova.compute.manager [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Neutron deleted interface 80ebe795-140c-43d3-a071-f9b0ce708bd8; detaching it from the instance and deleting it from the info cache
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [{"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "address": "fa:16:3e:ef:68:49", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fcd02c3-9f", "ovs_interfaceid": "6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Detach interface failed, port_id=80ebe795-140c-43d3-a071-f9b0ce708bd8, reason: Instance 927720cf-b009-4f9d-8e54-1b5cd3788e99 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-deleted-6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:30 user nova-compute[75239]: INFO nova.compute.manager [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Neutron deleted interface 6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1; detaching it from the instance and deleting it from the info cache
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [{"id": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "address": "fa:16:3e:13:7c:4f", "network": {"id": "000df844-a6fb-4c88-b39f-2adbfe4693af", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1579155982-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b3076cd-3c", "ovs_interfaceid": "5b3076cd-3c9c-4261-9361-c18fb53f1a38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "address": "fa:16:3e:00:d8:af", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96cbdec2-47", "ovs_interfaceid": "96cbdec2-4706-42b7-aaa4-5eeabd622a4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74b0eca2-dc64-4486-8194-83f22572f6af", "address": "fa:16:3e:6e:97:c3", "network": {"id": "5469b692-3a35-472e-afe4-fd7e9cc96d9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-53364619", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9ba6493d9174244bc27bacaec40b580", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74b0eca2-dc", "ovs_interfaceid": "74b0eca2-dc64-4486-8194-83f22572f6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-d8ab6f0d-b5f4-437a-a22f-5efde7b3b12e req-39cbe083-b5d2-4bb7-b9b8-8673e2ad7114 service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Detach interface failed, port_id=6fcd02c3-9f96-48e6-9e50-ba3c6c1ed3c1, reason: Instance 927720cf-b009-4f9d-8e54-1b5cd3788e99 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:35:30 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:30 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Took 4.30 seconds to deallocate network for instance.
Nov 13 20:35:31 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:35:31 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:35:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:35:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:35:31 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:35:31 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updating instance_info_cache with network_info: [{"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-f91c80c5-5a6d-41b1-bc07-d8cb6b345445 req-137f2d85-64cc-46fa-94a9-4061e26c6e2c service nova] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Received event network-vif-deleted-5b3076cd-3c9c-4261-9361-c18fb53f1a38 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:32 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897 is timed out.
Nov 13 20:35:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Successfully detached device vdb from instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897 from the live domain config.
Nov 13 20:35:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvIurQfl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:32 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77077c2-95ab-4e56-9ebf-ed48fc88cf4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:35:32 user nova-compute[75239]: No targets found.
Nov 13 20:35:32 user nova-compute[75239]: iSNS:
Nov 13 20:35:32 user nova-compute[75239]: No targets found.
Nov 13 20:35:32 user nova-compute[75239]: STATIC:
Nov 13 20:35:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d
Nov 13 20:35:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:35:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:32 user nova-compute[75239]: FIRMWARE:
Nov 13 20:35:32 user nova-compute[75239]: No targets found.
Nov 13 20:35:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:35:32 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:35:32 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c02f67-51bc-4487-9437-f97518d8dfe0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e7c724-9f2d-425a-8323-3b2ea4c540ea]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:32 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:32 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d (non-flash)
Nov 13 20:35:32 user nova-compute[75239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:32 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d845d1990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d'): ({'sdg'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Removing single pathed devices sdg {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ceba04-211e-4bef-afab-4706a6c15b37]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f98b0-48b7-434f-80ae-67184c3f529d]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Flushing IO for device /dev/sdg {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71d1a21-83d6-4bc9-b267-a4bc1d5752d9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:35:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd24aca8-aad7-4f9d-956e-928411b58a63]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15868b5-1561-4c5a-86b4-c88f7b07d3ac]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b5deef-c7e7-4a41-a6bb-a1410da4146e]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d, portal: 172.16.0.220,3260]
Nov 13 20:35:33 user nova-compute[75239]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b685be2b-e941-4930-9004-a12ec1f3cb0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[89620f23-d52e-4a2f-9b0c-8cee04962413]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] <== disconnect_volume: return (333ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:35:33 user nova-compute[75239]: INFO nova.compute.manager [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] [instance: 927720cf-b009-4f9d-8e54-1b5cd3788e99] Took 2.24 seconds to detach 3 volumes for instance.
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:33 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Deleted allocations for instance 927720cf-b009-4f9d-8e54-1b5cd3788e99
Nov 13 20:35:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7a75802b-013c-4d70-8be2-412352d2c3b5 tempest-TaggedBootDevicesTest-1300668237 tempest-TaggedBootDevicesTest-1300668237-project-member] Lock "927720cf-b009-4f9d-8e54-1b5cd3788e99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.731s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.objects.instance [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lazy-loading 'flavor' on Instance uuid 01d607cc-47f6-4c80-a7f2-3db54c1ce897 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-340f0a6b-a738-4f0d-8452-42d5ffc82aad tempest-VolumesAssistedSnapshotsTest-621592759 tempest-VolumesAssistedSnapshotsTest-621592759-project-admin] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.932s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:35:34 user nova-compute[75239]: INFO nova.compute.claims [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Claim successful on node user
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:35:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:35:34 user nova-compute[75239]: DEBUG nova.policy [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2669d647fe6f4034bc70703546345eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465510aec2849dfb0917120a772f066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:35:34 user nova-compute[75239]: INFO nova.virt.block_device [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Booting with blank volume at /dev/vda
Nov 13 20:35:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Successfully created port: c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:35:35 user nova-compute[75239]: INFO nova.compute.claims [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Claim successful on node user
Nov 13 20:35:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:35:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.policy [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21fc417bc25944ffb15dd30f9d7f0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d28d93b700143a988524063d92a102a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:35:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Creating image(s)
Nov 13 20:35:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Successfully updated port: c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-e329b195-c51b-4507-8cf5-83735721d6ca req-1b9548c0-39d9-4e86-8247-82518d3759d8 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-changed-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-e329b195-c51b-4507-8cf5-83735721d6ca req-1b9548c0-39d9-4e86-8247-82518d3759d8 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Refreshing instance network info cache due to event network-changed-c95a6584-e3cd-4beb-8917-2bb935d8b507. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e329b195-c51b-4507-8cf5-83735721d6ca req-1b9548c0-39d9-4e86-8247-82518d3759d8 service nova] Acquiring lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e329b195-c51b-4507-8cf5-83735721d6ca req-1b9548c0-39d9-4e86-8247-82518d3759d8 service nova] Acquired lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.network.neutron [req-e329b195-c51b-4507-8cf5-83735721d6ca req-1b9548c0-39d9-4e86-8247-82518d3759d8 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Refreshing network info cache for port c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.network.neutron [req-e329b195-c51b-4507-8cf5-83735721d6ca req-1b9548c0-39d9-4e86-8247-82518d3759d8 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.network.neutron [req-e329b195-c51b-4507-8cf5-83735721d6ca req-1b9548c0-39d9-4e86-8247-82518d3759d8 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e329b195-c51b-4507-8cf5-83735721d6ca req-1b9548c0-39d9-4e86-8247-82518d3759d8 service nova] Releasing lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquired lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk 1073741824" returned: 0 in 0.045s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Cannot resize image /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Ensure instance console log exists: /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Successfully created port: 70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updating instance_info_cache with network_info: [{"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Releasing lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:35:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance network_info: |[{"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Successfully updated port: 70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquired lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updating instance_info_cache with network_info: [{"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Releasing lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance network_info: |[{"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Start _get_guest_xml network_info=[{"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:35:37 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:35:37 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123715306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123715306',id=13,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJycNLU0bhy2XhsxZOHqqC+x4cDsTf3LnWsRNHL6hFFjdVyVlQXzzyjCQn8YoXQ+dHwMmMoUvJN6eB/MQBaXgQ4735nV4x22OZ4jbmasf6gYcJu0Wwdvr27XrHBBoqb+OQ==',key_name='tempest-keypair-2045310531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-26o52j6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=c3f6a68e-f57c-463f-81fd-e4e047421d5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.objects.instance [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'pci_devices' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:35:37 user nova-compute[75239]:   <uuid>c3f6a68e-f57c-463f-81fd-e4e047421d5b</uuid>
Nov 13 20:35:37 user nova-compute[75239]:   <name>instance-0000000d</name>
Nov 13 20:35:37 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:35:37 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:35:37 user nova-compute[75239]:   <metadata>
Nov 13 20:35:37 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:35:37 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:35:37 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-123715306</nova:name>
Nov 13 20:35:37 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:35:37</nova:creationTime>
Nov 13 20:35:37 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:35:37 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:35:37 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:35:37 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:35:37 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:35:37 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:35:37 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:35:37 user nova-compute[75239]:       <nova:owner>
Nov 13 20:35:37 user nova-compute[75239]:         <nova:user uuid="21fc417bc25944ffb15dd30f9d7f0760">tempest-AttachVolumeShelveTestJSON-2022096331-project-member</nova:user>
Nov 13 20:35:37 user nova-compute[75239]:         <nova:project uuid="2d28d93b700143a988524063d92a102a">tempest-AttachVolumeShelveTestJSON-2022096331</nova:project>
Nov 13 20:35:37 user nova-compute[75239]:       </nova:owner>
Nov 13 20:35:37 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:35:37 user nova-compute[75239]:       <nova:ports>
Nov 13 20:35:37 user nova-compute[75239]:         <nova:port uuid="70460a6e-b85a-4875-94c8-fa1917a78871">
Nov 13 20:35:37 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 20:35:37 user nova-compute[75239]:         </nova:port>
Nov 13 20:35:37 user nova-compute[75239]:       </nova:ports>
Nov 13 20:35:37 user nova-compute[75239]:     </nova:instance>
Nov 13 20:35:37 user nova-compute[75239]:   </metadata>
Nov 13 20:35:37 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:35:37 user nova-compute[75239]:     <system>
Nov 13 20:35:37 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:35:37 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:35:37 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:35:37 user nova-compute[75239]:       <entry name="serial">c3f6a68e-f57c-463f-81fd-e4e047421d5b</entry>
Nov 13 20:35:37 user nova-compute[75239]:       <entry name="uuid">c3f6a68e-f57c-463f-81fd-e4e047421d5b</entry>
Nov 13 20:35:37 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:35:37 user nova-compute[75239]:     </system>
Nov 13 20:35:37 user nova-compute[75239]:   </sysinfo>
Nov 13 20:35:37 user nova-compute[75239]:   <os>
Nov 13 20:35:37 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:35:37 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:35:37 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:35:37 user nova-compute[75239]:   </os>
Nov 13 20:35:37 user nova-compute[75239]:   <features>
Nov 13 20:35:37 user nova-compute[75239]:     <acpi/>
Nov 13 20:35:37 user nova-compute[75239]:     <apic/>
Nov 13 20:35:37 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:35:37 user nova-compute[75239]:   </features>
Nov 13 20:35:37 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:35:37 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:35:37 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:35:37 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:35:37 user nova-compute[75239]:   </clock>
Nov 13 20:35:37 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:35:37 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:35:37 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:35:37 user nova-compute[75239]:   </cpu>
Nov 13 20:35:37 user nova-compute[75239]:   <devices>
Nov 13 20:35:37 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:35:37 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:35:37 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk"/>
Nov 13 20:35:37 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:35:37 user nova-compute[75239]:     </disk>
Nov 13 20:35:37 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:35:37 user nova-compute[75239]:       <mac address="fa:16:3e:1b:c8:80"/>
Nov 13 20:35:37 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:35:37 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:35:37 user nova-compute[75239]:       <target dev="tap70460a6e-b8"/>
Nov 13 20:35:37 user nova-compute[75239]:     </interface>
Nov 13 20:35:37 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:35:37 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/console.log" append="off"/>
Nov 13 20:35:37 user nova-compute[75239]:     </serial>
Nov 13 20:35:37 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:35:37 user nova-compute[75239]:     <video>
Nov 13 20:35:37 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:35:37 user nova-compute[75239]:     </video>
Nov 13 20:35:37 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:35:37 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:35:37 user nova-compute[75239]:     </rng>
Nov 13 20:35:37 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:35:37 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:35:37 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:35:37 user nova-compute[75239]:     </memballoon>
Nov 13 20:35:37 user nova-compute[75239]:   </devices>
Nov 13 20:35:37 user nova-compute[75239]: </domain>
Nov 13 20:35:37 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123715306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123715306',id=13,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJycNLU0bhy2XhsxZOHqqC+x4cDsTf3LnWsRNHL6hFFjdVyVlQXzzyjCQn8YoXQ+dHwMmMoUvJN6eB/MQBaXgQ4735nV4x22OZ4jbmasf6gYcJu0Wwdvr27XrHBBoqb+OQ==',key_name='tempest-keypair-2045310531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-26o52j6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=c3f6a68e-f57c-463f-81fd-e4e047421d5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG os_vif [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2adefc7c-3663-5f2c-912d-2b15301a4db1', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70460a6e-b8, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70460a6e-b8, col_values=(('qos', UUID('858e9134-be0d-4cda-b2d6-ff38d5b245f6')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70460a6e-b8, col_values=(('external_ids', {'iface-id': '70460a6e-b85a-4875-94c8-fa1917a78871', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:c8:80', 'vm-uuid': 'c3f6a68e-f57c-463f-81fd-e4e047421d5b'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:37 user nova-compute[75239]: INFO os_vif [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8')
Nov 13 20:35:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:35:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] No VIF found with MAC fa:16:3e:1b:c8:80, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:35:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-260123ba-ad70-4d13-bab3-a3738f704fa7 req-4a83384c-f22b-456f-961f-a218b3852c51 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-changed-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-260123ba-ad70-4d13-bab3-a3738f704fa7 req-4a83384c-f22b-456f-961f-a218b3852c51 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Refreshing instance network info cache due to event network-changed-70460a6e-b85a-4875-94c8-fa1917a78871. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:35:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-260123ba-ad70-4d13-bab3-a3738f704fa7 req-4a83384c-f22b-456f-961f-a218b3852c51 service nova] Acquiring lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:35:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-260123ba-ad70-4d13-bab3-a3738f704fa7 req-4a83384c-f22b-456f-961f-a218b3852c51 service nova] Acquired lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:35:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-260123ba-ad70-4d13-bab3-a3738f704fa7 req-4a83384c-f22b-456f-961f-a218b3852c51 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Refreshing network info cache for port 70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:35:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-260123ba-ad70-4d13-bab3-a3738f704fa7 req-4a83384c-f22b-456f-961f-a218b3852c51 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updated VIF entry in instance network info cache for port 70460a6e-b85a-4875-94c8-fa1917a78871. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:35:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-260123ba-ad70-4d13-bab3-a3738f704fa7 req-4a83384c-f22b-456f-961f-a218b3852c51 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updating instance_info_cache with network_info: [{"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-260123ba-ad70-4d13-bab3-a3738f704fa7 req-4a83384c-f22b-456f-961f-a218b3852c51 service nova] Releasing lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:35:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] No waiting events found dispatching network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:40 user nova-compute[75239]: WARNING nova.compute.manager [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received unexpected event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 for instance with vm_state building and task_state spawning.
Nov 13 20:35:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] No waiting events found dispatching network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:40 user nova-compute[75239]: WARNING nova.compute.manager [req-1a7003cd-a9d5-40a7-aecd-5cfab1f7fed0 req-3f15c10a-e96d-4358-b51c-d0baa10a4177 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received unexpected event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 for instance with vm_state building and task_state spawning.
Nov 13 20:35:40 user nova-compute[75239]: DEBUG os_brick.utils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e5e8fe-20a9-495f-9d6b-9e8e697f14b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f54126-3a6c-4f33-a176-a208593690e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90c6303-fd91-467d-b72e-faa0e90be485]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9352e984-7c18-42ae-a2e3-e9002f7adbef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:35:40 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:35:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac67a0a7-cbff-4074-9558-616217331626]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG os_brick.utils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:40 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updating existing volume attachment record: 2a1a787a-f316-43d2-95ee-d01d6c3537c3 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:35:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 is timed out.
Nov 13 20:35:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Successfully detached device vdb from instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 from the live domain config.
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fjsBFyzm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'ff71d5c5-9140-4781-9441-4430e66eda16'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:41 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad6d78-bc82-4121-af5b-52279bbdaa89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:35:41 user nova-compute[75239]: No targets found.
Nov 13 20:35:41 user nova-compute[75239]: iSNS:
Nov 13 20:35:41 user nova-compute[75239]: No targets found.
Nov 13 20:35:41 user nova-compute[75239]: STATIC:
Nov 13 20:35:41 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16
Nov 13 20:35:41 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:41 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:41 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:35:41 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:35:41 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:35:41 user nova-compute[75239]: FIRMWARE:
Nov 13 20:35:41 user nova-compute[75239]: No targets found.
Nov 13 20:35:41 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:35:41 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:35:41 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a6b8a3-5891-45be-8579-cf44ed089856]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[795adcfe-3bcd-459a-878d-e2af619f7a72]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:41 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:41 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 (non-flash)
Nov 13 20:35:41 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:41 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d6059b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16'): ({'sdj'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Removing single pathed devices sdj {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance spawned successfully.
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d75934-ecd6-499f-99d1-622bf3367a72]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4cbe01-ed32-4b00-9797-2457bdd700cc]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Flushing IO for device /dev/sdj {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b3477f-ea0b-445c-8152-07b9c679b1d7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[89003fb2-7103-4aee-9496-909e2e0505b6]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] SCSI volumes sdj have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: INFO nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b400ad-7866-44a8-bd21-68401a14bd46]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa4331c-bccd-40b1-9e94-cf4f0dc88d43]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260]
Nov 13 20:35:41 user nova-compute[75239]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:41 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:41 user nova-compute[75239]: INFO nova.compute.manager [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Took 6.35 seconds to build instance.
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1227f24a-60d1-4a61-b14a-a2d4582231a3 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.446s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff71d5c5-9140-4781-9441-4430e66eda16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89aa35c-5c4f-49a2-b8c5-a3cc018f5b70]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] <== disconnect_volume: return (338ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:35:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:42 user nova-compute[75239]: DEBUG nova.objects.instance [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lazy-loading 'flavor' on Instance uuid ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-01db0979-434a-40aa-984e-7ca28cdfd17a tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "a193f654-074c-454c-91b2-bb7ced39fb59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "a193f654-074c-454c-91b2-bb7ced39fb59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:35:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:35:43 user nova-compute[75239]: INFO nova.compute.claims [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Claim successful on node user
Nov 13 20:35:43 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:35:43 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:35:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:35:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.policy [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '781343c1a6e94234bef9a8d11cea0f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edd5f6a62ab945aead252eec2f72112b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:35:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Creating image(s)
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "/opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "/opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "/opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk 1073741824" returned: 0 in 0.051s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Successfully created port: 2620304b-4a98-49b9-ba78-db9473a7478a {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:35:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Creating image(s)
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Ensure instance console log exists: /opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Start _get_guest_xml network_info=[{"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2a1a787a-f316-43d2-95ee-d01d6c3537c3', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbyMxieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1796f4bf-40b0-4a4a-85a5-3690fb761031', 'attached_at': '', 'detached_at': '', 'volume_id': '1e524d23-a0bd-40df-bd81-6e30dcb200ad', 'serial': '1e524d23-a0bd-40df-bd81-6e30dcb200ad'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:35:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:35:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbyMxieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:35:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:35:44 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e207ca3c-4ebe-49a2-bddd-522c5d378673]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:35:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeec0839-dcd5-44c9-8c91-35c57176c53c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad] added
Nov 13 20:35:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bb36b7-0222-41ea-81b8-c58a64d9b6f7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b11391-6740-48ae-bdb6-f5a2b7c5347b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbyMxieG {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbyMxieG" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[481f2bd4-9609-42c8-9fb8-84dc9018ebb3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wbyMxieG'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c508ff8-5052-4c3c-a927-3a36374d66f0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Cannot resize image /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Ensure instance console log exists: /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3317c54a-c3a0-405f-a46f-d9dcf0723796]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb6a3b5-c9f9-4462-a197-3d684835266b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad, portal: 172.16.0.220,3260]
Nov 13 20:35:45 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad, portal: 172.16.0.220,3260] successful.
Nov 13 20:35:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9136b7a6-32b9-4b15-8650-a4cbbb17fda7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa7083e-b985-4e5e-b925-09bc33f860f5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:35:45 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:35:45 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:35:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf39671-0eb2-4374-b082-e1998ea0f517]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbyMxieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Successfully updated port: 2620304b-4a98-49b9-ba78-db9473a7478a {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "refresh_cache-a193f654-074c-454c-91b2-bb7ced39fb59" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquired lock "refresh_cache-a193f654-074c-454c-91b2-bb7ced39fb59" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f55f2f7-acb0-4833-b7b7-0cfb37436476 req-f1642427-9136-4a81-a78c-98c715e78a89 service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Received event network-changed-2620304b-4a98-49b9-ba78-db9473a7478a {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f55f2f7-acb0-4833-b7b7-0cfb37436476 req-f1642427-9136-4a81-a78c-98c715e78a89 service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Refreshing instance network info cache due to event network-changed-2620304b-4a98-49b9-ba78-db9473a7478a. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f55f2f7-acb0-4833-b7b7-0cfb37436476 req-f1642427-9136-4a81-a78c-98c715e78a89 service nova] Acquiring lock "refresh_cache-a193f654-074c-454c-91b2-bb7ced39fb59" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Updating instance_info_cache with network_info: [{"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Releasing lock "refresh_cache-a193f654-074c-454c-91b2-bb7ced39fb59" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Instance network_info: |[{"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f55f2f7-acb0-4833-b7b7-0cfb37436476 req-f1642427-9136-4a81-a78c-98c715e78a89 service nova] Acquired lock "refresh_cache-a193f654-074c-454c-91b2-bb7ced39fb59" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.network.neutron [req-8f55f2f7-acb0-4833-b7b7-0cfb37436476 req-f1642427-9136-4a81-a78c-98c715e78a89 service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Refreshing network info cache for port 2620304b-4a98-49b9-ba78-db9473a7478a {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Start _get_guest_xml network_info=[{"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:35:45 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:35:45 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-996528989',display_name='tempest-VolumesAdminNegativeTest-server-996528989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-996528989',id=14,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edd5f6a62ab945aead252eec2f72112b',ramdisk_id='',reservation_id='r-78ge18ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1388057922',owner_user_name='tempest-VolumesAdminNegativeTest-1388057922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:35:44Z,user_data=None,user_id='781343c1a6e94234bef9a8d11cea0f9c',uuid=a193f654-074c-454c-91b2-bb7ced39fb59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converting VIF {"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:b6,bridge_name='br-int',has_traffic_filtering=True,id=2620304b-4a98-49b9-ba78-db9473a7478a,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620304b-4a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.objects.instance [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lazy-loading 'pci_devices' on Instance uuid a193f654-074c-454c-91b2-bb7ced39fb59 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:35:45 user nova-compute[75239]:   <uuid>a193f654-074c-454c-91b2-bb7ced39fb59</uuid>
Nov 13 20:35:45 user nova-compute[75239]:   <name>instance-0000000e</name>
Nov 13 20:35:45 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:35:45 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:35:45 user nova-compute[75239]:   <metadata>
Nov 13 20:35:45 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:35:45 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:35:45 user nova-compute[75239]:       <nova:name>tempest-VolumesAdminNegativeTest-server-996528989</nova:name>
Nov 13 20:35:45 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:35:45</nova:creationTime>
Nov 13 20:35:45 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:35:45 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:35:45 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:35:45 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:35:45 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:35:45 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:35:45 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:35:45 user nova-compute[75239]:       <nova:owner>
Nov 13 20:35:45 user nova-compute[75239]:         <nova:user uuid="781343c1a6e94234bef9a8d11cea0f9c">tempest-VolumesAdminNegativeTest-1388057922-project-member</nova:user>
Nov 13 20:35:45 user nova-compute[75239]:         <nova:project uuid="edd5f6a62ab945aead252eec2f72112b">tempest-VolumesAdminNegativeTest-1388057922</nova:project>
Nov 13 20:35:45 user nova-compute[75239]:       </nova:owner>
Nov 13 20:35:45 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:35:45 user nova-compute[75239]:       <nova:ports>
Nov 13 20:35:45 user nova-compute[75239]:         <nova:port uuid="2620304b-4a98-49b9-ba78-db9473a7478a">
Nov 13 20:35:45 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 20:35:45 user nova-compute[75239]:         </nova:port>
Nov 13 20:35:45 user nova-compute[75239]:       </nova:ports>
Nov 13 20:35:45 user nova-compute[75239]:     </nova:instance>
Nov 13 20:35:45 user nova-compute[75239]:   </metadata>
Nov 13 20:35:45 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:35:45 user nova-compute[75239]:     <system>
Nov 13 20:35:45 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:35:45 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:35:45 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:35:45 user nova-compute[75239]:       <entry name="serial">a193f654-074c-454c-91b2-bb7ced39fb59</entry>
Nov 13 20:35:45 user nova-compute[75239]:       <entry name="uuid">a193f654-074c-454c-91b2-bb7ced39fb59</entry>
Nov 13 20:35:45 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:35:45 user nova-compute[75239]:     </system>
Nov 13 20:35:45 user nova-compute[75239]:   </sysinfo>
Nov 13 20:35:45 user nova-compute[75239]:   <os>
Nov 13 20:35:45 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:35:45 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:35:45 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:35:45 user nova-compute[75239]:   </os>
Nov 13 20:35:45 user nova-compute[75239]:   <features>
Nov 13 20:35:45 user nova-compute[75239]:     <acpi/>
Nov 13 20:35:45 user nova-compute[75239]:     <apic/>
Nov 13 20:35:45 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:35:45 user nova-compute[75239]:   </features>
Nov 13 20:35:45 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:35:45 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:35:45 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:35:45 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:35:45 user nova-compute[75239]:   </clock>
Nov 13 20:35:45 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:35:45 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:35:45 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:35:45 user nova-compute[75239]:   </cpu>
Nov 13 20:35:45 user nova-compute[75239]:   <devices>
Nov 13 20:35:45 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:35:45 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:35:45 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk"/>
Nov 13 20:35:45 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:35:45 user nova-compute[75239]:     </disk>
Nov 13 20:35:45 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:35:45 user nova-compute[75239]:       <mac address="fa:16:3e:5c:b3:b6"/>
Nov 13 20:35:45 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:35:45 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:35:45 user nova-compute[75239]:       <target dev="tap2620304b-4a"/>
Nov 13 20:35:45 user nova-compute[75239]:     </interface>
Nov 13 20:35:45 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:35:45 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/console.log" append="off"/>
Nov 13 20:35:45 user nova-compute[75239]:     </serial>
Nov 13 20:35:45 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:35:45 user nova-compute[75239]:     <video>
Nov 13 20:35:45 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:35:45 user nova-compute[75239]:     </video>
Nov 13 20:35:45 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:35:45 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:35:45 user nova-compute[75239]:     </rng>
Nov 13 20:35:45 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:35:45 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:35:45 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:35:45 user nova-compute[75239]:     </memballoon>
Nov 13 20:35:45 user nova-compute[75239]:   </devices>
Nov 13 20:35:45 user nova-compute[75239]: </domain>
Nov 13 20:35:45 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-996528989',display_name='tempest-VolumesAdminNegativeTest-server-996528989',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-996528989',id=14,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='edd5f6a62ab945aead252eec2f72112b',ramdisk_id='',reservation_id='r-78ge18ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1388057922',owner_user_name='tempest-VolumesAdminNegativeTest-1388057922-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:35:44Z,user_data=None,user_id='781343c1a6e94234bef9a8d11cea0f9c',uuid=a193f654-074c-454c-91b2-bb7ced39fb59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converting VIF {"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:b6,bridge_name='br-int',has_traffic_filtering=True,id=2620304b-4a98-49b9-ba78-db9473a7478a,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620304b-4a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG os_vif [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:b6,bridge_name='br-int',has_traffic_filtering=True,id=2620304b-4a98-49b9-ba78-db9473a7478a,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620304b-4a') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9bd50a5-a93d-5d0a-81f6-30aff0df5f96', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2620304b-4a, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2620304b-4a, col_values=(('qos', UUID('cc227974-8705-4590-80ba-2d70462a7f4e')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2620304b-4a, col_values=(('external_ids', {'iface-id': '2620304b-4a98-49b9-ba78-db9473a7478a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:b3:b6', 'vm-uuid': 'a193f654-074c-454c-91b2-bb7ced39fb59'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:45 user nova-compute[75239]: INFO os_vif [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:b6,bridge_name='br-int',has_traffic_filtering=True,id=2620304b-4a98-49b9-ba78-db9473a7478a,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620304b-4a')
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:35:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] No VIF found with MAC fa:16:3e:5c:b3:b6, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.network.neutron [req-8f55f2f7-acb0-4833-b7b7-0cfb37436476 req-f1642427-9136-4a81-a78c-98c715e78a89 service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Updated VIF entry in instance network info cache for port 2620304b-4a98-49b9-ba78-db9473a7478a. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.network.neutron [req-8f55f2f7-acb0-4833-b7b7-0cfb37436476 req-f1642427-9136-4a81-a78c-98c715e78a89 service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Updating instance_info_cache with network_info: [{"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f55f2f7-acb0-4833-b7b7-0cfb37436476 req-f1642427-9136-4a81-a78c-98c715e78a89 service nova] Releasing lock "refresh_cache-a193f654-074c-454c-91b2-bb7ced39fb59" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23466663431633039', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466663431633039', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-340052940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-340052940',id=12,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-4wazebw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:35:35Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=1796f4bf-40b0-4a4a-85a5-3690fb761031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=c95a6584-e3cd-4beb-8917-2bb935d8b507,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc95a6584-e3') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'pci_devices' on Instance uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:35:46 user nova-compute[75239]:   <uuid>1796f4bf-40b0-4a4a-85a5-3690fb761031</uuid>
Nov 13 20:35:46 user nova-compute[75239]:   <name>instance-0000000c</name>
Nov 13 20:35:46 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:35:46 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:35:46 user nova-compute[75239]:   <metadata>
Nov 13 20:35:46 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:35:46 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:35:46 user nova-compute[75239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-340052940</nova:name>
Nov 13 20:35:46 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:35:44</nova:creationTime>
Nov 13 20:35:46 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:35:46 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:35:46 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:35:46 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:35:46 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:35:46 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:35:46 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:35:46 user nova-compute[75239]:       <nova:owner>
Nov 13 20:35:46 user nova-compute[75239]:         <nova:user uuid="2669d647fe6f4034bc70703546345eb3">tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member</nova:user>
Nov 13 20:35:46 user nova-compute[75239]:         <nova:project uuid="f465510aec2849dfb0917120a772f066">tempest-ServerBootFromVolumeStableRescueTest-2033691872</nova:project>
Nov 13 20:35:46 user nova-compute[75239]:       </nova:owner>
Nov 13 20:35:46 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:35:46 user nova-compute[75239]:       <nova:ports>
Nov 13 20:35:46 user nova-compute[75239]:         <nova:port uuid="c95a6584-e3cd-4beb-8917-2bb935d8b507">
Nov 13 20:35:46 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:35:46 user nova-compute[75239]:         </nova:port>
Nov 13 20:35:46 user nova-compute[75239]:       </nova:ports>
Nov 13 20:35:46 user nova-compute[75239]:     </nova:instance>
Nov 13 20:35:46 user nova-compute[75239]:   </metadata>
Nov 13 20:35:46 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:35:46 user nova-compute[75239]:     <system>
Nov 13 20:35:46 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:35:46 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:35:46 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:35:46 user nova-compute[75239]:       <entry name="serial">1796f4bf-40b0-4a4a-85a5-3690fb761031</entry>
Nov 13 20:35:46 user nova-compute[75239]:       <entry name="uuid">1796f4bf-40b0-4a4a-85a5-3690fb761031</entry>
Nov 13 20:35:46 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:35:46 user nova-compute[75239]:     </system>
Nov 13 20:35:46 user nova-compute[75239]:   </sysinfo>
Nov 13 20:35:46 user nova-compute[75239]:   <os>
Nov 13 20:35:46 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:35:46 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:35:46 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:35:46 user nova-compute[75239]:   </os>
Nov 13 20:35:46 user nova-compute[75239]:   <features>
Nov 13 20:35:46 user nova-compute[75239]:     <acpi/>
Nov 13 20:35:46 user nova-compute[75239]:     <apic/>
Nov 13 20:35:46 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:35:46 user nova-compute[75239]:   </features>
Nov 13 20:35:46 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:35:46 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:35:46 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:35:46 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:35:46 user nova-compute[75239]:   </clock>
Nov 13 20:35:46 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:35:46 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:35:46 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:35:46 user nova-compute[75239]:   </cpu>
Nov 13 20:35:46 user nova-compute[75239]:   <devices>
Nov 13 20:35:46 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:35:46 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:35:46 user nova-compute[75239]:       <source dev="/dev/sdb"/>
Nov 13 20:35:46 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:35:46 user nova-compute[75239]:       <serial>1e524d23-a0bd-40df-bd81-6e30dcb200ad</serial>
Nov 13 20:35:46 user nova-compute[75239]:     </disk>
Nov 13 20:35:46 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:35:46 user nova-compute[75239]:       <mac address="fa:16:3e:ae:cf:cd"/>
Nov 13 20:35:46 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:35:46 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:35:46 user nova-compute[75239]:       <target dev="tapc95a6584-e3"/>
Nov 13 20:35:46 user nova-compute[75239]:     </interface>
Nov 13 20:35:46 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:35:46 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/console.log" append="off"/>
Nov 13 20:35:46 user nova-compute[75239]:     </serial>
Nov 13 20:35:46 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:35:46 user nova-compute[75239]:     <video>
Nov 13 20:35:46 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:35:46 user nova-compute[75239]:     </video>
Nov 13 20:35:46 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:35:46 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:35:46 user nova-compute[75239]:     </rng>
Nov 13 20:35:46 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:35:46 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:35:46 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:35:46 user nova-compute[75239]:     </memballoon>
Nov 13 20:35:46 user nova-compute[75239]:   </devices>
Nov 13 20:35:46 user nova-compute[75239]: </domain>
Nov 13 20:35:46 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-340052940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-340052940',id=12,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-4wazebw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:35:35Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=1796f4bf-40b0-4a4a-85a5-3690fb761031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=c95a6584-e3cd-4beb-8917-2bb935d8b507,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc95a6584-e3') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG os_vif [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=c95a6584-e3cd-4beb-8917-2bb935d8b507,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc95a6584-e3') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6737e8cc-9034-5370-8d58-dafc02b72c54', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc95a6584-e3, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc95a6584-e3, col_values=(('qos', UUID('327c4874-409d-49d3-aab0-a0c435dccea2')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc95a6584-e3, col_values=(('external_ids', {'iface-id': 'c95a6584-e3cd-4beb-8917-2bb935d8b507', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:cf:cd', 'vm-uuid': '1796f4bf-40b0-4a4a-85a5-3690fb761031'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:46 user nova-compute[75239]: INFO os_vif [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=c95a6584-e3cd-4beb-8917-2bb935d8b507,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc95a6584-e3')
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:35:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No VIF found with MAC fa:16:3e:ae:cf:cd, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:35:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-de613ba4-2e10-42c6-b72e-326cb881f9c5 req-cb2d993f-3f96-446b-9215-5a69cf06f5ba service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Received event network-vif-plugged-2620304b-4a98-49b9-ba78-db9473a7478a {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-de613ba4-2e10-42c6-b72e-326cb881f9c5 req-cb2d993f-3f96-446b-9215-5a69cf06f5ba service nova] Acquiring lock "a193f654-074c-454c-91b2-bb7ced39fb59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-de613ba4-2e10-42c6-b72e-326cb881f9c5 req-cb2d993f-3f96-446b-9215-5a69cf06f5ba service nova] Lock "a193f654-074c-454c-91b2-bb7ced39fb59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-de613ba4-2e10-42c6-b72e-326cb881f9c5 req-cb2d993f-3f96-446b-9215-5a69cf06f5ba service nova] Lock "a193f654-074c-454c-91b2-bb7ced39fb59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-de613ba4-2e10-42c6-b72e-326cb881f9c5 req-cb2d993f-3f96-446b-9215-5a69cf06f5ba service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] No waiting events found dispatching network-vif-plugged-2620304b-4a98-49b9-ba78-db9473a7478a {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:48 user nova-compute[75239]: WARNING nova.compute.manager [req-de613ba4-2e10-42c6-b72e-326cb881f9c5 req-cb2d993f-3f96-446b-9215-5a69cf06f5ba service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Received unexpected event network-vif-plugged-2620304b-4a98-49b9-ba78-db9473a7478a for instance with vm_state building and task_state spawning.
Nov 13 20:35:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Received event network-vif-plugged-2620304b-4a98-49b9-ba78-db9473a7478a {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] Acquiring lock "a193f654-074c-454c-91b2-bb7ced39fb59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] Lock "a193f654-074c-454c-91b2-bb7ced39fb59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] Lock "a193f654-074c-454c-91b2-bb7ced39fb59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] No waiting events found dispatching network-vif-plugged-2620304b-4a98-49b9-ba78-db9473a7478a {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:50 user nova-compute[75239]: WARNING nova.compute.manager [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Received unexpected event network-vif-plugged-2620304b-4a98-49b9-ba78-db9473a7478a for instance with vm_state building and task_state spawning.
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:50 user nova-compute[75239]: WARNING nova.compute.manager [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state building and task_state spawning.
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:35:50 user nova-compute[75239]: WARNING nova.compute.manager [req-3f4b2a8e-161b-446d-9f07-a529d846ffd0 req-108a5993-9ff4-4266-9c46-09703d7d0093 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state building and task_state spawning.
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:35:50 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Instance spawned successfully.
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:35:50 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance spawned successfully.
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:35:50 user nova-compute[75239]: INFO nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:35:50 user nova-compute[75239]: INFO nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 13 20:35:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:35:50 user nova-compute[75239]: INFO nova.compute.manager [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Took 7.36 seconds to build instance.
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-736f4bfc-8ff3-4b83-9058-6b5dcae38281 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "a193f654-074c-454c-91b2-bb7ced39fb59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.475s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:50 user nova-compute[75239]: INFO nova.compute.manager [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Took 16.75 seconds to build instance.
Nov 13 20:35:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a66433e0-db50-4098-bd21-8d7e3b1682d5 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.851s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:35:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:35:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:04 user nova-compute[75239]: INFO nova.compute.manager [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Terminating instance
Nov 13 20:36:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:36:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-113702f1-f1e7-4d1e-a481-2e5024db8dc2 req-69da45d6-0599-4107-a6b5-6a266360116b service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received event network-vif-unplugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-113702f1-f1e7-4d1e-a481-2e5024db8dc2 req-69da45d6-0599-4107-a6b5-6a266360116b service nova] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-113702f1-f1e7-4d1e-a481-2e5024db8dc2 req-69da45d6-0599-4107-a6b5-6a266360116b service nova] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-113702f1-f1e7-4d1e-a481-2e5024db8dc2 req-69da45d6-0599-4107-a6b5-6a266360116b service nova] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-113702f1-f1e7-4d1e-a481-2e5024db8dc2 req-69da45d6-0599-4107-a6b5-6a266360116b service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] No waiting events found dispatching network-vif-unplugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-113702f1-f1e7-4d1e-a481-2e5024db8dc2 req-69da45d6-0599-4107-a6b5-6a266360116b service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received event network-vif-unplugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:36:05 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Instance destroyed successfully.
Nov 13 20:36:05 user nova-compute[75239]: DEBUG nova.objects.instance [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lazy-loading 'resources' on Instance uuid 01d607cc-47f6-4c80-a7f2-3db54c1ce897 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1048217050',display_name='tempest-VolumesAssistedSnapshotsTest-server-1048217050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1048217050',id=9,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItRmdZhxQB3rCu+RLhzYWCU0a3D8sXGkB0YPOLGwgWMO9lw7FvLjY2t+Q1OHIwMNryX1sdsWjhPBYfW6atHsSo+80pOJt2b7izxfEfKncwxHkGvoZgnzshCzr5YFc9+zQ==',key_name='tempest-keypair-1526853124',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8dfaaeee24be479fbaac2cd308a81c81',ramdisk_id='',reservation_id='r-2i6du10v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-527196103',owner_user_name='tempest-VolumesAssistedSnapshotsTest-527196103-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:33:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d95aebf5be2842edbf74038ebd160bdd',uuid=01d607cc-47f6-4c80-a7f2-3db54c1ce897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Converting VIF {"id": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "address": "fa:16:3e:99:56:06", "network": {"id": "17e1e114-fe89-4bd5-a7fb-539afc6fb06e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1999446257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfaaeee24be479fbaac2cd308a81c81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e4a5db-35", "ovs_interfaceid": "02e4a5db-35bd-4e10-92de-3a0f4e635ab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:56:06,bridge_name='br-int',has_traffic_filtering=True,id=02e4a5db-35bd-4e10-92de-3a0f4e635ab0,network=Network(17e1e114-fe89-4bd5-a7fb-539afc6fb06e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e4a5db-35') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG os_vif [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:56:06,bridge_name='br-int',has_traffic_filtering=True,id=02e4a5db-35bd-4e10-92de-3a0f4e635ab0,network=Network(17e1e114-fe89-4bd5-a7fb-539afc6fb06e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e4a5db-35') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02e4a5db-35, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc4af8e6-94eb-4479-9412-76d7ff78c90c) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:05 user nova-compute[75239]: INFO os_vif [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:56:06,bridge_name='br-int',has_traffic_filtering=True,id=02e4a5db-35bd-4e10-92de-3a0f4e635ab0,network=Network(17e1e114-fe89-4bd5-a7fb-539afc6fb06e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e4a5db-35')
Nov 13 20:36:05 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Deleting instance files /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897_del
Nov 13 20:36:05 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Deletion of /opt/stack/data/nova/instances/01d607cc-47f6-4c80-a7f2-3db54c1ce897_del complete
Nov 13 20:36:05 user nova-compute[75239]: INFO nova.compute.manager [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 20:36:05 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:36:05 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:36:06 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:06 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Took 0.81 seconds to deallocate network for instance.
Nov 13 20:36:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-3e95995f-94ea-4bab-bb88-385a2cd0eccf req-56ddbd67-6122-4150-9bb8-01dcc2ab1071 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received event network-vif-deleted-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:06 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:36:06 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:36:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:06 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Deleted allocations for instance 01d607cc-47f6-4c80-a7f2-3db54c1ce897
Nov 13 20:36:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-abd7a8c0-c598-4ef1-9314-893e87fa6b94 tempest-VolumesAssistedSnapshotsTest-527196103 tempest-VolumesAssistedSnapshotsTest-527196103-project-member] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-1607258c-7462-43f9-89d2-acdcf745154c req-c16b02ec-9e2d-4f71-9c1a-c45568069e45 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received event network-vif-plugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1607258c-7462-43f9-89d2-acdcf745154c req-c16b02ec-9e2d-4f71-9c1a-c45568069e45 service nova] Acquiring lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1607258c-7462-43f9-89d2-acdcf745154c req-c16b02ec-9e2d-4f71-9c1a-c45568069e45 service nova] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1607258c-7462-43f9-89d2-acdcf745154c req-c16b02ec-9e2d-4f71-9c1a-c45568069e45 service nova] Lock "01d607cc-47f6-4c80-a7f2-3db54c1ce897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-1607258c-7462-43f9-89d2-acdcf745154c req-c16b02ec-9e2d-4f71-9c1a-c45568069e45 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] No waiting events found dispatching network-vif-plugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:07 user nova-compute[75239]: WARNING nova.compute.manager [req-1607258c-7462-43f9-89d2-acdcf745154c req-c16b02ec-9e2d-4f71-9c1a-c45568069e45 service nova] [instance: 01d607cc-47f6-4c80-a7f2-3db54c1ce897] Received unexpected event network-vif-plugged-02e4a5db-35bd-4e10-92de-3a0f4e635ab0 for instance with vm_state deleted and task_state None.
Nov 13 20:36:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:11 user nova-compute[75239]: INFO nova.compute.manager [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Terminating instance
Nov 13 20:36:11 user nova-compute[75239]: DEBUG nova.compute.manager [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-f9dff162-9f55-46e7-bffd-20128e82af46 req-a7fccb6f-b575-4ce8-9089-fd4ad655e58f service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received event network-vif-unplugged-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f9dff162-9f55-46e7-bffd-20128e82af46 req-a7fccb6f-b575-4ce8-9089-fd4ad655e58f service nova] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f9dff162-9f55-46e7-bffd-20128e82af46 req-a7fccb6f-b575-4ce8-9089-fd4ad655e58f service nova] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f9dff162-9f55-46e7-bffd-20128e82af46 req-a7fccb6f-b575-4ce8-9089-fd4ad655e58f service nova] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-f9dff162-9f55-46e7-bffd-20128e82af46 req-a7fccb6f-b575-4ce8-9089-fd4ad655e58f service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] No waiting events found dispatching network-vif-unplugged-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-f9dff162-9f55-46e7-bffd-20128e82af46 req-a7fccb6f-b575-4ce8-9089-fd4ad655e58f service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received event network-vif-unplugged-e017651b-4710-4d2f-a57a-73401f644453 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Instance destroyed successfully.
Nov 13 20:36:11 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lazy-loading 'resources' on Instance uuid ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2077274202',display_name='tempest-TestVolumeSwap-server-2077274202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2077274202',id=8,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6wgz9E12YiGgS+BDu49tgXowLJ5cJiGop8l9sNIpqKOAb5FO2+KRuxyTcuxLaCEp17h4QfV/mBePHdOEfl/A41Jsi1L3Y/8/Mb5yWlTteBCasQbXkHvrHAFP3Xw4/9BQ==',key_name='tempest-keypair-819734159',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b15357eef6014b2aa9783fa80a958011',ramdisk_id='',reservation_id='r-0m0ewv6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-896183856',owner_user_name='tempest-TestVolumeSwap-896183856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85e59f5a0e6642d3857838ba05dfca9f',uuid=ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Converting VIF {"id": "e017651b-4710-4d2f-a57a-73401f644453", "address": "fa:16:3e:e7:81:89", "network": {"id": "21522351-1b9b-45a4-b246-7f519983e127", "bridge": "br-int", "label": "tempest-TestVolumeSwap-631921121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b15357eef6014b2aa9783fa80a958011", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape017651b-47", "ovs_interfaceid": "e017651b-4710-4d2f-a57a-73401f644453", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:81:89,bridge_name='br-int',has_traffic_filtering=True,id=e017651b-4710-4d2f-a57a-73401f644453,network=Network(21522351-1b9b-45a4-b246-7f519983e127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape017651b-47') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG os_vif [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:81:89,bridge_name='br-int',has_traffic_filtering=True,id=e017651b-4710-4d2f-a57a-73401f644453,network=Network(21522351-1b9b-45a4-b246-7f519983e127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape017651b-47') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape017651b-47, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d05a514-4cba-47ea-8609-50a975d86511) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:11 user nova-compute[75239]: INFO os_vif [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:81:89,bridge_name='br-int',has_traffic_filtering=True,id=e017651b-4710-4d2f-a57a-73401f644453,network=Network(21522351-1b9b-45a4-b246-7f519983e127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape017651b-47')
Nov 13 20:36:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Deleting instance files /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03_del
Nov 13 20:36:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Deletion of /opt/stack/data/nova/instances/ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03_del complete
Nov 13 20:36:12 user nova-compute[75239]: INFO nova.compute.manager [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 20:36:12 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:36:12 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:36:12 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:36:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-89802c94-1cf2-4e99-9068-d5ee6bb6c6df req-c74c827d-5c0d-4096-bc4b-4d428330ea24 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received event network-vif-deleted-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:13 user nova-compute[75239]: INFO nova.compute.manager [req-89802c94-1cf2-4e99-9068-d5ee6bb6c6df req-c74c827d-5c0d-4096-bc4b-4d428330ea24 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Neutron deleted interface e017651b-4710-4d2f-a57a-73401f644453; detaching it from the instance and deleting it from the info cache
Nov 13 20:36:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-89802c94-1cf2-4e99-9068-d5ee6bb6c6df req-c74c827d-5c0d-4096-bc4b-4d428330ea24 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:13 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Took 1.46 seconds to deallocate network for instance.
Nov 13 20:36:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-35425b9b-fe11-42b9-89e8-541522bd253c req-489b65b3-dad1-4910-8d04-efe24a497ded service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received event network-vif-plugged-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-35425b9b-fe11-42b9-89e8-541522bd253c req-489b65b3-dad1-4910-8d04-efe24a497ded service nova] Acquiring lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-35425b9b-fe11-42b9-89e8-541522bd253c req-489b65b3-dad1-4910-8d04-efe24a497ded service nova] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-35425b9b-fe11-42b9-89e8-541522bd253c req-489b65b3-dad1-4910-8d04-efe24a497ded service nova] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-35425b9b-fe11-42b9-89e8-541522bd253c req-489b65b3-dad1-4910-8d04-efe24a497ded service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] No waiting events found dispatching network-vif-plugged-e017651b-4710-4d2f-a57a-73401f644453 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:13 user nova-compute[75239]: WARNING nova.compute.manager [req-35425b9b-fe11-42b9-89e8-541522bd253c req-489b65b3-dad1-4910-8d04-efe24a497ded service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Received unexpected event network-vif-plugged-e017651b-4710-4d2f-a57a-73401f644453 for instance with vm_state active and task_state deleting.
Nov 13 20:36:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-89802c94-1cf2-4e99-9068-d5ee6bb6c6df req-c74c827d-5c0d-4096-bc4b-4d428330ea24 service nova] [instance: ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03] Detach interface failed, port_id=e017651b-4710-4d2f-a57a-73401f644453, reason: Instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:36:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:13 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Deleted allocations for instance ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03
Nov 13 20:36:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e33a2fa2-4c9f-4715-9e55-4dcadb77683e tempest-TestVolumeSwap-896183856 tempest-TestVolumeSwap-896183856-project-member] Lock "ef10ac16-2ec9-4d5e-9131-9f9c3e29ad03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.910s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:36:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:36:20 user nova-compute[75239]: INFO nova.compute.claims [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Claim successful on node user
Nov 13 20:36:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.network.neutron [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:36:21 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.policy [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d8ae2d158f94548bc3d9873317935cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14ce616b1ad4ee7934e34bad1fdf6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:36:21 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Creating image(s)
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG nova.objects.instance [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'flavor' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.196s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk 1073741824" returned: 0 in 0.055s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:21 user nova-compute[75239]: INFO nova.compute.manager [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Attaching volume 00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a to /dev/vdb
Nov 13 20:36:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG os_brick.utils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f5a9c0-305d-48f3-9f07-74874653fa75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a3722-b58b-4d3f-8ae1-44f26d9ba9d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.216s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c8d20a-c165-4e82-bef9-b4c344882d05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Successfully created port: 6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4942f776-1f10-4c4c-af58-c2e89952b1c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:36:22 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7398dd34-5aec-4a92-98b6-a70060f0490a]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG os_brick.utils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating existing volume attachment record: 8ecd5952-beaf-418f-9886-4148f6fdbab2 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Cannot resize image /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Ensure instance console log exists: /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Successfully updated port: 6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "refresh_cache-55f96b7f-454c-440a-9c78-f91305569e87" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquired lock "refresh_cache-55f96b7f-454c-440a-9c78-f91305569e87" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-3984c162-c2f3-4746-a374-285b878bc900 req-bb239b7d-2f71-469f-a3de-c4fa588d9c19 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-changed-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-3984c162-c2f3-4746-a374-285b878bc900 req-bb239b7d-2f71-469f-a3de-c4fa588d9c19 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Refreshing instance network info cache due to event network-changed-6563fee0-5628-49c4-b7f9-fb4799a36f70. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:36:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3984c162-c2f3-4746-a374-285b878bc900 req-bb239b7d-2f71-469f-a3de-c4fa588d9c19 service nova] Acquiring lock "refresh_cache-55f96b7f-454c-440a-9c78-f91305569e87" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.network.neutron [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.network.neutron [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Updating instance_info_cache with network_info: [{"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Releasing lock "refresh_cache-55f96b7f-454c-440a-9c78-f91305569e87" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Instance network_info: |[{"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3984c162-c2f3-4746-a374-285b878bc900 req-bb239b7d-2f71-469f-a3de-c4fa588d9c19 service nova] Acquired lock "refresh_cache-55f96b7f-454c-440a-9c78-f91305569e87" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-3984c162-c2f3-4746-a374-285b878bc900 req-bb239b7d-2f71-469f-a3de-c4fa588d9c19 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Refreshing network info cache for port 6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Start _get_guest_xml network_info=[{"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:36:23 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:23 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2064952916',display_name='tempest-tempest.common.compute-instance-2064952916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2064952916',id=15,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKe5xKWesSL7Xw6hcWc4RxdUahUkI+jkhDI4apiyCjXCfdLyQGOUt2pNUDacBxYeCp79YzytY/4Z4U7ALB2dqrqOE/L6p+WHD/S3QIse6iYs3wKwrVsyDyEByaRhcB+ag==',key_name='tempest-keypair-403991548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-1gj70kp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=55f96b7f-454c-440a-9c78-f91305569e87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'pci_devices' on Instance uuid 55f96b7f-454c-440a-9c78-f91305569e87 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:36:23 user nova-compute[75239]:   <uuid>55f96b7f-454c-440a-9c78-f91305569e87</uuid>
Nov 13 20:36:23 user nova-compute[75239]:   <name>instance-0000000f</name>
Nov 13 20:36:23 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:36:23 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:36:23 user nova-compute[75239]:   <metadata>
Nov 13 20:36:23 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:36:23 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:36:23 user nova-compute[75239]:       <nova:name>tempest-tempest.common.compute-instance-2064952916</nova:name>
Nov 13 20:36:23 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:36:23</nova:creationTime>
Nov 13 20:36:23 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:36:23 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:36:23 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:36:23 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:36:23 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:36:23 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:36:23 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:36:23 user nova-compute[75239]:       <nova:owner>
Nov 13 20:36:23 user nova-compute[75239]:         <nova:user uuid="3d8ae2d158f94548bc3d9873317935cd">tempest-ServerActionsTestOtherA-1210141142-project-member</nova:user>
Nov 13 20:36:23 user nova-compute[75239]:         <nova:project uuid="e14ce616b1ad4ee7934e34bad1fdf6a3">tempest-ServerActionsTestOtherA-1210141142</nova:project>
Nov 13 20:36:23 user nova-compute[75239]:       </nova:owner>
Nov 13 20:36:23 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:36:23 user nova-compute[75239]:       <nova:ports>
Nov 13 20:36:23 user nova-compute[75239]:         <nova:port uuid="6563fee0-5628-49c4-b7f9-fb4799a36f70">
Nov 13 20:36:23 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:36:23 user nova-compute[75239]:         </nova:port>
Nov 13 20:36:23 user nova-compute[75239]:       </nova:ports>
Nov 13 20:36:23 user nova-compute[75239]:     </nova:instance>
Nov 13 20:36:23 user nova-compute[75239]:   </metadata>
Nov 13 20:36:23 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:36:23 user nova-compute[75239]:     <system>
Nov 13 20:36:23 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:36:23 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:36:23 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:36:23 user nova-compute[75239]:       <entry name="serial">55f96b7f-454c-440a-9c78-f91305569e87</entry>
Nov 13 20:36:23 user nova-compute[75239]:       <entry name="uuid">55f96b7f-454c-440a-9c78-f91305569e87</entry>
Nov 13 20:36:23 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:36:23 user nova-compute[75239]:     </system>
Nov 13 20:36:23 user nova-compute[75239]:   </sysinfo>
Nov 13 20:36:23 user nova-compute[75239]:   <os>
Nov 13 20:36:23 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:36:23 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:36:23 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:36:23 user nova-compute[75239]:   </os>
Nov 13 20:36:23 user nova-compute[75239]:   <features>
Nov 13 20:36:23 user nova-compute[75239]:     <acpi/>
Nov 13 20:36:23 user nova-compute[75239]:     <apic/>
Nov 13 20:36:23 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:36:23 user nova-compute[75239]:   </features>
Nov 13 20:36:23 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:36:23 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:36:23 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:36:23 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:36:23 user nova-compute[75239]:   </clock>
Nov 13 20:36:23 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:36:23 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:36:23 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:36:23 user nova-compute[75239]:   </cpu>
Nov 13 20:36:23 user nova-compute[75239]:   <devices>
Nov 13 20:36:23 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:36:23 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:36:23 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk"/>
Nov 13 20:36:23 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:36:23 user nova-compute[75239]:     </disk>
Nov 13 20:36:23 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:36:23 user nova-compute[75239]:       <mac address="fa:16:3e:12:8f:22"/>
Nov 13 20:36:23 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:23 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:36:23 user nova-compute[75239]:       <target dev="tap6563fee0-56"/>
Nov 13 20:36:23 user nova-compute[75239]:     </interface>
Nov 13 20:36:23 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:36:23 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/console.log" append="off"/>
Nov 13 20:36:23 user nova-compute[75239]:     </serial>
Nov 13 20:36:23 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:36:23 user nova-compute[75239]:     <video>
Nov 13 20:36:23 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:23 user nova-compute[75239]:     </video>
Nov 13 20:36:23 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:36:23 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:36:23 user nova-compute[75239]:     </rng>
Nov 13 20:36:23 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:36:23 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:36:23 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:36:23 user nova-compute[75239]:     </memballoon>
Nov 13 20:36:23 user nova-compute[75239]:   </devices>
Nov 13 20:36:23 user nova-compute[75239]: </domain>
Nov 13 20:36:23 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2064952916',display_name='tempest-tempest.common.compute-instance-2064952916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2064952916',id=15,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKe5xKWesSL7Xw6hcWc4RxdUahUkI+jkhDI4apiyCjXCfdLyQGOUt2pNUDacBxYeCp79YzytY/4Z4U7ALB2dqrqOE/L6p+WHD/S3QIse6iYs3wKwrVsyDyEByaRhcB+ag==',key_name='tempest-keypair-403991548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-1gj70kp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=55f96b7f-454c-440a-9c78-f91305569e87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG os_vif [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ed3f3e5-bfff-5adf-b03b-2ba0936325c0', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6563fee0-56, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6563fee0-56, col_values=(('qos', UUID('f59c7429-f85b-497b-9cb6-9d80a65e7cce')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6563fee0-56, col_values=(('external_ids', {'iface-id': '6563fee0-5628-49c4-b7f9-fb4799a36f70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:8f:22', 'vm-uuid': '55f96b7f-454c-440a-9c78-f91305569e87'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:23 user nova-compute[75239]: INFO os_vif [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56')
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No VIF found with MAC fa:16:3e:12:8f:22, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-3984c162-c2f3-4746-a374-285b878bc900 req-bb239b7d-2f71-469f-a3de-c4fa588d9c19 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Updated VIF entry in instance network info cache for port 6563fee0-5628-49c4-b7f9-fb4799a36f70. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-3984c162-c2f3-4746-a374-285b878bc900 req-bb239b7d-2f71-469f-a3de-c4fa588d9c19 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Updating instance_info_cache with network_info: [{"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3984c162-c2f3-4746-a374-285b878bc900 req-bb239b7d-2f71-469f-a3de-c4fa588d9c19 service nova] Releasing lock "refresh_cache-55f96b7f-454c-440a-9c78-f91305569e87" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:24 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquired lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:24 user nova-compute[75239]: DEBUG nova.network.neutron [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:36:24 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'info_cache' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:24 user nova-compute[75239]: DEBUG nova.objects.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating instance_info_cache with network_info: [{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Releasing lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:25 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance destroyed successfully.
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'resources' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.objects.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1584967376',display_name='tempest-AttachVolumeTestJSON-server-1584967376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1584967376',id=2,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKLqFZyQUrPE9Rky07V7+GOb/b3wRFXW0Dqh5CX+FEDomGoakG24id5wbLzS4TXRnaOkbwA4OVXWvMEC23O9oNn05+UEn3Pmq3JjLiMnSUlNw/+Sk65Td7hW84pUseSw==',key_name='tempest-keypair-823327680',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-9qfk4iec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=f59ce508-2487-4e71-8c09-ffd17dd0eafc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_vif [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf2c8770-f7, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cc75552-80de-45bf-a5cb-7ee3aa2081c4) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:25 user nova-compute[75239]: INFO os_vif [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7')
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSfhYNrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:36:25 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf335ee6-7785-4158-aa29-8914debe906e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:36:25 user nova-compute[75239]: No targets found.
Nov 13 20:36:25 user nova-compute[75239]: iSNS:
Nov 13 20:36:25 user nova-compute[75239]: No targets found.
Nov 13 20:36:25 user nova-compute[75239]: STATIC:
Nov 13 20:36:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:36:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:36:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:36:25 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:36:25 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:36:25 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:36:25 user nova-compute[75239]: FIRMWARE:
Nov 13 20:36:25 user nova-compute[75239]: No targets found.
Nov 13 20:36:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:36:25 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:36:25 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[881dd178-6598-4847-8176-298cb332e7ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[505c1bc3-0ea8-4850-af5b-d24a4fe9849d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:25 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:25 user nova-compute[75239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d842268c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0'): ({'sde'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Removing single pathed devices sde {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd273cdc-7478-41c8-bdf5-eac3095468ee]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac5ff27-2564-49f0-8312-5afce4ae187b]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flushing IO for device /dev/sde {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d1d573-b363-4179-b457-e1d8f788da1f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c2dc44-1aa3-4ca1-9093-82500333b820]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe258cf-ee12-4b09-84fe-f27d9c443663]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.140s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2de0402-f42e-40df-95c2-419074dc22e9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260]
Nov 13 20:36:25 user nova-compute[75239]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260] successful.
Nov 13 20:36:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-2957142e-cc96-4681-bd04-e1bdbe8d9e5a req-1ea30aa0-4679-4fc7-ac8e-fb5fb6dfe4ef service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2957142e-cc96-4681-bd04-e1bdbe8d9e5a req-1ea30aa0-4679-4fc7-ac8e-fb5fb6dfe4ef service nova] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2957142e-cc96-4681-bd04-e1bdbe8d9e5a req-1ea30aa0-4679-4fc7-ac8e-fb5fb6dfe4ef service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2957142e-cc96-4681-bd04-e1bdbe8d9e5a req-1ea30aa0-4679-4fc7-ac8e-fb5fb6dfe4ef service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-2957142e-cc96-4681-bd04-e1bdbe8d9e5a req-1ea30aa0-4679-4fc7-ac8e-fb5fb6dfe4ef service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] No waiting events found dispatching network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:25 user nova-compute[75239]: WARNING nova.compute.manager [req-2957142e-cc96-4681-bd04-e1bdbe8d9e5a req-1ea30aa0-4679-4fc7-ac8e-fb5fb6dfe4ef service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received unexpected event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 for instance with vm_state building and task_state spawning.
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[75581fb6-e325-4388-b696-7e5259e11fa5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== disconnect_volume: return (408ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Start _get_guest_xml network_info=[{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2a905e13-d364-4142-a70c-54e0a6be568e', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSfhYNrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f59ce508-2487-4e71-8c09-ffd17dd0eafc', 'attached_at': '', 'detached_at': '', 'volume_id': '211604d0-2297-4169-9d9f-1034e5ff23b0', 'serial': '211604d0-2297-4169-9d9f-1034e5ff23b0'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'numa_topology' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.objects.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:25 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:25 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'vcpu_model' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.objects.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSfhYNrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:36:25 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:36:25 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:36:25 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab821c68-879a-4dc8-ae2f-92740bfcd47a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:36:25 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd9f413-4426-4ba8-bd42-fcd259a1f656]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0] added
Nov 13 20:36:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b60bfc2-6456-4f2b-8880-1a09a86a1a2b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b01917-c550-4fb9-a049-a8e3fc8f4d5c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSfhYNrF {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jSfhYNrF" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f979f1-84f6-4f4d-a7a5-456a79e03463]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jSfhYNrF'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb1988-76c6-40d3-b258-2dd2a640e62c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60ac3ad-87b7-411f-aba2-6209809e1246]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:36:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[62424f0e-4fac-4e35-875c-b0046a71cdce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260]
Nov 13 20:36:26 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260] successful.
Nov 13 20:36:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[994378cf-6917-4aaf-8949-b996b21616b1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1f994b-4fcf-43a0-84ed-b422f1027344]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:26 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:26 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[744bd847-6eb2-4364-991f-1a4ec20e1615]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSfhYNrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYrbHCzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:36:26 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:36:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23832613432626264', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832613432626264', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.309s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:36:27 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:36:27 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f8f99-728c-4942-99d7-34ea9ed15ca4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:36:27 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1584967376',display_name='tempest-AttachVolumeTestJSON-server-1584967376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1584967376',id=2,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKLqFZyQUrPE9Rky07V7+GOb/b3wRFXW0Dqh5CX+FEDomGoakG24id5wbLzS4TXRnaOkbwA4OVXWvMEC23O9oNn05+UEn3Pmq3JjLiMnSUlNw/+Sk65Td7hW84pUseSw==',key_name='tempest-keypair-823327680',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-9qfk4iec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=f59ce508-2487-4e71-8c09-ffd17dd0eafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'pci_devices' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e66d1c4-7e94-4692-ae85-32ba230779cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a] added
Nov 13 20:36:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e09f00e-ff73-4582-8ed7-1fb5849a8114]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.objects.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:36:27 user nova-compute[75239]:   <uuid>f59ce508-2487-4e71-8c09-ffd17dd0eafc</uuid>
Nov 13 20:36:27 user nova-compute[75239]:   <name>instance-00000002</name>
Nov 13 20:36:27 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:36:27 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:36:27 user nova-compute[75239]:   <metadata>
Nov 13 20:36:27 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:36:27 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:36:27 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeTestJSON-server-1584967376</nova:name>
Nov 13 20:36:27 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:36:25</nova:creationTime>
Nov 13 20:36:27 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:36:27 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:36:27 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:36:27 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:36:27 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:36:27 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:36:27 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:36:27 user nova-compute[75239]:       <nova:owner>
Nov 13 20:36:27 user nova-compute[75239]:         <nova:user uuid="a1fa0bf5a26e4844a22d48ce70d8dc0a">tempest-AttachVolumeTestJSON-2111443236-project-member</nova:user>
Nov 13 20:36:27 user nova-compute[75239]:         <nova:project uuid="b0a86eedbea84af3a57a6a4b266c06d4">tempest-AttachVolumeTestJSON-2111443236</nova:project>
Nov 13 20:36:27 user nova-compute[75239]:       </nova:owner>
Nov 13 20:36:27 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:36:27 user nova-compute[75239]:       <nova:ports>
Nov 13 20:36:27 user nova-compute[75239]:         <nova:port uuid="af2c8770-f7b4-4446-8061-7c377b8ad1f5">
Nov 13 20:36:27 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:36:27 user nova-compute[75239]:         </nova:port>
Nov 13 20:36:27 user nova-compute[75239]:       </nova:ports>
Nov 13 20:36:27 user nova-compute[75239]:     </nova:instance>
Nov 13 20:36:27 user nova-compute[75239]:   </metadata>
Nov 13 20:36:27 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:36:27 user nova-compute[75239]:     <system>
Nov 13 20:36:27 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:36:27 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:36:27 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:36:27 user nova-compute[75239]:       <entry name="serial">f59ce508-2487-4e71-8c09-ffd17dd0eafc</entry>
Nov 13 20:36:27 user nova-compute[75239]:       <entry name="uuid">f59ce508-2487-4e71-8c09-ffd17dd0eafc</entry>
Nov 13 20:36:27 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:36:27 user nova-compute[75239]:     </system>
Nov 13 20:36:27 user nova-compute[75239]:   </sysinfo>
Nov 13 20:36:27 user nova-compute[75239]:   <os>
Nov 13 20:36:27 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:36:27 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:36:27 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:36:27 user nova-compute[75239]:   </os>
Nov 13 20:36:27 user nova-compute[75239]:   <features>
Nov 13 20:36:27 user nova-compute[75239]:     <acpi/>
Nov 13 20:36:27 user nova-compute[75239]:     <apic/>
Nov 13 20:36:27 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:36:27 user nova-compute[75239]:   </features>
Nov 13 20:36:27 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:36:27 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:36:27 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:36:27 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:36:27 user nova-compute[75239]:   </clock>
Nov 13 20:36:27 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:36:27 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:36:27 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:36:27 user nova-compute[75239]:   </cpu>
Nov 13 20:36:27 user nova-compute[75239]:   <devices>
Nov 13 20:36:27 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:36:27 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:36:27 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk"/>
Nov 13 20:36:27 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:36:27 user nova-compute[75239]:     </disk>
Nov 13 20:36:27 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:36:27 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:36:27 user nova-compute[75239]:       <source dev="/dev/sdc"/>
Nov 13 20:36:27 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:36:27 user nova-compute[75239]:       <serial>211604d0-2297-4169-9d9f-1034e5ff23b0</serial>
Nov 13 20:36:27 user nova-compute[75239]:     </disk>
Nov 13 20:36:27 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:36:27 user nova-compute[75239]:       <mac address="fa:16:3e:9f:11:19"/>
Nov 13 20:36:27 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:27 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:36:27 user nova-compute[75239]:       <target dev="tapaf2c8770-f7"/>
Nov 13 20:36:27 user nova-compute[75239]:     </interface>
Nov 13 20:36:27 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:36:27 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/console.log" append="off"/>
Nov 13 20:36:27 user nova-compute[75239]:     </serial>
Nov 13 20:36:27 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:36:27 user nova-compute[75239]:     <video>
Nov 13 20:36:27 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:27 user nova-compute[75239]:     </video>
Nov 13 20:36:27 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:36:27 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:36:27 user nova-compute[75239]:     </rng>
Nov 13 20:36:27 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:36:27 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:36:27 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:36:27 user nova-compute[75239]:     </memballoon>
Nov 13 20:36:27 user nova-compute[75239]:   </devices>
Nov 13 20:36:27 user nova-compute[75239]: </domain>
Nov 13 20:36:27 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7219f0-1287-4a7e-a3df-3759743797ba]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYrbHCzx {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYrbHCzx" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ffe4ce-698b-4537-ba54-084c2102bbc4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VYrbHCzx'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[734c3765-8ffb-4ae7-8c2e-ceee33dfedfd]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e7ef2b-70b0-420a-823d-623e19860902]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:27 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:27 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bd6cfe-d978-4354-9075-4c48f8969d3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a, portal: 172.16.0.220,3260]
Nov 13 20:36:27 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a, portal: 172.16.0.220,3260] successful.
Nov 13 20:36:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:36:27 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Instance spawned successfully.
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88ee9dc-55df-4d3d-9476-66035c75b433]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6757e024-2ee6-4187-b425-23f13ae6ea36]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:27 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:27 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:36:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:27 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:27 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:36:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.453s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1cf966-e583-44bc-87d5-85d8c0425709]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYrbHCzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-40148a89-e6e2-448c-a9f2-003657a8c11a req-5b5f6ecd-e401-479c-8e98-9b9fa4951676 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-40148a89-e6e2-448c-a9f2-003657a8c11a req-5b5f6ecd-e401-479c-8e98-9b9fa4951676 service nova] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-40148a89-e6e2-448c-a9f2-003657a8c11a req-5b5f6ecd-e401-479c-8e98-9b9fa4951676 service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-40148a89-e6e2-448c-a9f2-003657a8c11a req-5b5f6ecd-e401-479c-8e98-9b9fa4951676 service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-40148a89-e6e2-448c-a9f2-003657a8c11a req-5b5f6ecd-e401-479c-8e98-9b9fa4951676 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] No waiting events found dispatching network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:27 user nova-compute[75239]: WARNING nova.compute.manager [req-40148a89-e6e2-448c-a9f2-003657a8c11a req-5b5f6ecd-e401-479c-8e98-9b9fa4951676 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received unexpected event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 for instance with vm_state building and task_state spawning.
Nov 13 20:36:27 user nova-compute[75239]: INFO nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'trusted_certs' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.objects.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: INFO nova.compute.manager [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Took 7.15 seconds to build instance.
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7740a8fc-232e-428b-8614-f86b8b05caaf tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.430s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:36:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Cannot resize image /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'migration_context' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG nova.objects.base [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1584967376',display_name='tempest-AttachVolumeTestJSON-server-1584967376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1584967376',id=2,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKLqFZyQUrPE9Rky07V7+GOb/b3wRFXW0Dqh5CX+FEDomGoakG24id5wbLzS4TXRnaOkbwA4OVXWvMEC23O9oNn05+UEn3Pmq3JjLiMnSUlNw/+Sk65Td7hW84pUseSw==',key_name='tempest-keypair-823327680',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-9qfk4iec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=f59ce508-2487-4e71-8c09-ffd17dd0eafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG os_vif [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf7f58c3-2746-521a-93e7-2a26466a9f03', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf2c8770-f7, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf2c8770-f7, col_values=(('qos', UUID('6d951ced-3009-41e0-b5d2-2a684d03578b')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf2c8770-f7, col_values=(('external_ids', {'iface-id': 'af2c8770-f7b4-4446-8061-7c377b8ad1f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:11:19', 'vm-uuid': 'f59ce508-2487-4e71-8c09-ffd17dd0eafc'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:28 user nova-compute[75239]: INFO os_vif [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7')
Nov 13 20:36:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] <== connect_volume: return (1804ms) {'type': 'block', 'scsi_wwn': '23961636239383337', 'path': '/dev/sdd'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961636239383337', 'path': '/dev/sdd'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'flavor' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-f617138d-e9ae-42c2-b431-abdd542a34d8 req-6ddce6bb-0d68-49de-bd13-1afb38c4b400 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f617138d-e9ae-42c2-b431-abdd542a34d8 req-6ddce6bb-0d68-49de-bd13-1afb38c4b400 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f617138d-e9ae-42c2-b431-abdd542a34d8 req-6ddce6bb-0d68-49de-bd13-1afb38c4b400 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f617138d-e9ae-42c2-b431-abdd542a34d8 req-6ddce6bb-0d68-49de-bd13-1afb38c4b400 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-f617138d-e9ae-42c2-b431-abdd542a34d8 req-6ddce6bb-0d68-49de-bd13-1afb38c4b400 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:32 user nova-compute[75239]: WARNING nova.compute.manager [req-f617138d-e9ae-42c2-b431-abdd542a34d8 req-6ddce6bb-0d68-49de-bd13-1afb38c4b400 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state powering-on.
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:36:32 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:36:32 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:36:32 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:36:32 user nova-compute[75239]:   <serial>00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a</serial>
Nov 13 20:36:32 user nova-compute[75239]: </disk>
Nov 13 20:36:32 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:36:32 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:32 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8014MB free_disk=25.338329315185547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance rebooted successfully.
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-2b195ca0-9965-45ff-975d-8ae3129eaab9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d67fcb6b-fb37-4d04-8dab-d74370f76981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ae8531d9-3930-4373-91b2-628d850e8ba7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c3f6a68e-f57c-463f-81fd-e4e047421d5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a193f654-074c-454c-91b2-bb7ced39fb59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 55f96b7f-454c-440a-9c78-f91305569e87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] No VIF found with MAC fa:16:3e:64:63:b2, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f24a8b88-1e63-499e-af36-baaba60afe79 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.983s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:32 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:36:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:36:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.721s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-5d93f33e-5f19-4f34-aa34-a1fbbcd70b42 req-3b1bd8f2-5c63-4e61-b515-a1fa98d2c646 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5d93f33e-5f19-4f34-aa34-a1fbbcd70b42 req-3b1bd8f2-5c63-4e61-b515-a1fa98d2c646 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5d93f33e-5f19-4f34-aa34-a1fbbcd70b42 req-3b1bd8f2-5c63-4e61-b515-a1fa98d2c646 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5d93f33e-5f19-4f34-aa34-a1fbbcd70b42 req-3b1bd8f2-5c63-4e61-b515-a1fa98d2c646 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-5d93f33e-5f19-4f34-aa34-a1fbbcd70b42 req-3b1bd8f2-5c63-4e61-b515-a1fa98d2c646 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:33 user nova-compute[75239]: WARNING nova.compute.manager [req-5d93f33e-5f19-4f34-aa34-a1fbbcd70b42 req-3b1bd8f2-5c63-4e61-b515-a1fa98d2c646 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state active and task_state None.
Nov 13 20:36:34 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:34 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:34 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:36:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:34 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:36:34 user nova-compute[75239]: INFO nova.compute.manager [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Rescuing
Nov 13 20:36:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquired lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:34 user nova-compute[75239]: DEBUG nova.network.neutron [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updating instance_info_cache with network_info: [{"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating instance_info_cache with network_info: [{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Releasing lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-a4c17f27-1cf0-475e-841f-cb315d6a3c7c req-5ab5d904-97bc-4059-b8a9-a47483ed4ff2 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-unplugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a4c17f27-1cf0-475e-841f-cb315d6a3c7c req-5ab5d904-97bc-4059-b8a9-a47483ed4ff2 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a4c17f27-1cf0-475e-841f-cb315d6a3c7c req-5ab5d904-97bc-4059-b8a9-a47483ed4ff2 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a4c17f27-1cf0-475e-841f-cb315d6a3c7c req-5ab5d904-97bc-4059-b8a9-a47483ed4ff2 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-a4c17f27-1cf0-475e-841f-cb315d6a3c7c req-5ab5d904-97bc-4059-b8a9-a47483ed4ff2 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-unplugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:36 user nova-compute[75239]: WARNING nova.compute.manager [req-a4c17f27-1cf0-475e-841f-cb315d6a3c7c req-5ab5d904-97bc-4059-b8a9-a47483ed4ff2 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-unplugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state active and task_state rescuing.
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:36:36 user nova-compute[75239]: INFO nova.compute.claims [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Claim successful on node user
Nov 13 20:36:36 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Instance destroyed successfully.
Nov 13 20:36:36 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Attempting a stable device rescue
Nov 13 20:36:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Instance directory exists: not creating {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 20:36:36 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Creating image(s)
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'trusted_certs' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "90a9c5fb88a0a89821995148a9edede74347090a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "90a9c5fb88a0a89821995148a9edede74347090a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-c3aeca0b-048b-4f71-b99a-5f8ee29af7f4 req-904a888a-95eb-45cd-9196-622f691f8f97 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c3aeca0b-048b-4f71-b99a-5f8ee29af7f4 req-904a888a-95eb-45cd-9196-622f691f8f97 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c3aeca0b-048b-4f71-b99a-5f8ee29af7f4 req-904a888a-95eb-45cd-9196-622f691f8f97 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c3aeca0b-048b-4f71-b99a-5f8ee29af7f4 req-904a888a-95eb-45cd-9196-622f691f8f97 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-c3aeca0b-048b-4f71-b99a-5f8ee29af7f4 req-904a888a-95eb-45cd-9196-622f691f8f97 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:38 user nova-compute[75239]: WARNING nova.compute.manager [req-c3aeca0b-048b-4f71-b99a-5f8ee29af7f4 req-904a888a-95eb-45cd-9196-622f691f8f97 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state active and task_state rescuing.
Nov 13 20:36:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.virt.images [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] 1414a340-3ce6-485f-b254-aad68614838d was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a.part /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.728s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.network.neutron [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:36:38 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG nova.policy [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0adecc32b22a4d7a910320d9f6c4f2ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '100038f3462149338c8baaefb89970e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a.part /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a.converted" returned: 0 in 0.707s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:38 user nova-compute[75239]: INFO nova.virt.block_device [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Booting with volume 1faa23e0-a730-43ba-9425-eca3b7105d2f at /dev/vda
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.utils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac3bcb7-8f94-4693-a592-574598718ec6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0207b501-1e57-40d2-a8d9-694ca0079029]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "90a9c5fb88a0a89821995148a9edede74347090a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.309s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "90a9c5fb88a0a89821995148a9edede74347090a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "90a9c5fb88a0a89821995148a9edede74347090a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78f868f-695c-4cba-9a47-62574916615d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d68a04-d046-479f-9c61-b7d9d2af05e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:36:39 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[655951bc-baec-4e9f-959d-dab5c3b44479]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.utils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Updating existing volume attachment record: 892a3f8d-b6c9-4752-b4ee-8ae63d292d94 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a,backing_fmt=raw /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.rescue {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a,backing_fmt=raw /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.rescue" returned: 0 in 0.061s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "90a9c5fb88a0a89821995148a9edede74347090a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'migration_context' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Object Instance<d67fcb6b-fb37-4d04-8dab-d74370f76981> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Start _get_guest_xml network_info=[{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "vif_mac": "fa:16:3e:64:63:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1414a340-3ce6-485f-b254-aad68614838d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8ecd5952-beaf-418f-9886-4148f6fdbab2', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYrbHCzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd67fcb6b-fb37-4d04-8dab-d74370f76981', 'attached_at': '', 'detached_at': '', 'volume_id': '00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a', 'serial': '00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'resources' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Object Instance<d67fcb6b-fb37-4d04-8dab-d74370f76981> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'numa_topology' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Object Instance<d67fcb6b-fb37-4d04-8dab-d74370f76981> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:39 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:39 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'vcpu_model' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Object Instance<d67fcb6b-fb37-4d04-8dab-d74370f76981> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYrbHCzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:36:39 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:36:39 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:36:39 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Successfully created port: 37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86e11a2-802f-4d96-ac6c-3972fe94b7c5]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VYrbHCzx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 20:36:39 user nova-compute[75239]: node.name = iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a
Nov 13 20:36:39 user nova-compute[75239]: node.tpgt = -1
Nov 13 20:36:39 user nova-compute[75239]: node.startup = automatic
Nov 13 20:36:39 user nova-compute[75239]: node.leading_login = No
Nov 13 20:36:39 user nova-compute[75239]: iface.iscsi_ifacename = default
Nov 13 20:36:39 user nova-compute[75239]: iface.net_ifacename = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.ipaddress = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.prefix_len = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.hwaddress = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.transport_name = tcp
Nov 13 20:36:39 user nova-compute[75239]: iface.initiatorname = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.state = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.vlan_id = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.vlan_priority = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.vlan_state = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.iface_num = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.mtu = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.port = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.bootproto = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.subnet_mask = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.gateway = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.dhcp_alt_client_id = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.dhcp_dns = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.dhcp_learn_iqn = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.dhcp_vendor_id_state = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.dhcp_vendor_id = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.dhcp_slp_da = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.fragmentation = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.gratuitous_arp = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.incoming_forwarding = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.tos_state = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.tos = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.ttl = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.delayed_ack = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.tcp_nagle = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.tcp_wsf_state = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.tcp_wsf = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.tcp_timer_scale = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.tcp_timestamp = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.redirect = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.def_task_mgmt_timeout = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.header_digest = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.data_digest = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.immediate_data = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.initial_r2t = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.data_seq_inorder = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.data_pdu_inorder = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.erl = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.max_receive_data_len = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.first_burst_len = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.max_outstanding_r2t = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.max_burst_len = 0
Nov 13 20:36:39 user nova-compute[75239]: iface.chap_auth = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.bidi_chap = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.strict_login_compliance = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.discovery_auth = <empty>
Nov 13 20:36:39 user nova-compute[75239]: iface.discovery_logout = <empty>
Nov 13 20:36:39 user nova-compute[75239]: node.discovery_address = <empty>
Nov 13 20:36:39 user nova-compute[75239]: node.discovery_port = 0
Nov 13 20:36:39 user nova-compute[75239]: node.discovery_type = static
Nov 13 20:36:39 user nova-compute[75239]: node.session.initial_cmdsn = 0
Nov 13 20:36:39 user nova-compute[75239]: node.session.initial_login_retry_max = 8
Nov 13 20:36:39 user nova-compute[75239]: node.session.xmit_thread_priority = -20
Nov 13 20:36:39 user nova-compute[75239]: node.session.cmds_max = 128
Nov 13 20:36:39 user nova-compute[75239]: node.session.queue_depth = 32
Nov 13 20:36:39 user nova-compute[75239]: node.session.nr_sessions = 1
Nov 13 20:36:39 user nova-compute[75239]: node.session.auth.authmethod = CHAP
Nov 13 20:36:39 user nova-compute[75239]: node.session.auth.username = VYrbHCzx
Nov 13 20:36:39 user nova-compute[75239]: node.session.auth.password = ***
Nov 13 20:36:39 user nova-compute[75239]: node.session.auth.username_in = <empty>
Nov 13 20:36:39 user nova-compute[75239]: node.session.auth.password_in = <empty>
Nov 13 20:36:39 user nova-compute[75239]: node.session.auth.chap_algs = MD5
Nov 13 20:36:39 user nova-compute[75239]: node.session.timeo.replacement_timeout = 120
Nov 13 20:36:39 user nova-compute[75239]: node.session.err_timeo.abort_timeout = 15
Nov 13 20:36:39 user nova-compute[75239]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 20:36:39 user nova-compute[75239]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 20:36:39 user nova-compute[75239]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.FastAbort = Yes
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.InitialR2T = No
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.ImmediateData = Yes
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.MaxConnections = 1
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 20:36:39 user nova-compute[75239]: node.session.iscsi.ERL = 0
Nov 13 20:36:39 user nova-compute[75239]: node.session.scan = manual
Nov 13 20:36:39 user nova-compute[75239]: node.session.reopen_max = 0
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].address = 172.16.0.220
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].port = 3260
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].startup = manual
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].tcp.window_size = 524288
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].tcp.type_of_service = 0
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].timeo.logout_timeout = 15
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].timeo.login_timeout = 15
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].timeo.auth_timeout = 45
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].iscsi.DataDigest = None
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].iscsi.IFMarker = No
Nov 13 20:36:39 user nova-compute[75239]: node.conn[0].iscsi.OFMarker = No
Nov 13 20:36:39 user nova-compute[75239]: # END RECORD
Nov 13 20:36:39 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.102s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b45dbb-380e-4770-9370-0f2ee8598838]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3fb64b-47aa-4bce-a037-58aa61431f02]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYrbHCzx {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VYrbHCzx" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5607a15-0e4b-4703-bf84-7fa280edc1c5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VYrbHCzx'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[219c8821-198b-4b70-8c09-5c95aab5d16f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb987b-a365-4d3b-a162-5bfdf6a75d99]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:39 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:39 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:36:39 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:39 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:39 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:36:39 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] HCTL ('35', '0', '0', 0) found on session 16 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdf3e35-a24b-4bc4-aedd-dbdf605a75ea]: (4, ('0 0 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Searching for a device in session 16 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYrbHCzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.308s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] <== connect_volume: return (310ms) {'type': 'block', 'scsi_wwn': '23961636239383337', 'path': '/dev/sdd'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961636239383337', 'path': '/dev/sdd'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-616704806',display_name='tempest-ServerStableDeviceRescueTest-server-616704806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-616704806',id=5,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNyr6IAcaCWhTnd0M31N5isR2JfZGlfnnpnSCe2iTutyciIj40lB+x3H5rvcMVdsmn5oFtO37aMp9V7yFAx+Kfzowav3xLguTou77n7NO1lviCmuoo+BE+hwWUoq0BqMA==',key_name='tempest-keypair-2109943276',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce07a49816064edfbf14f89b5895e9e5',ramdisk_id='',reservation_id='r-hbacdswg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-456666962',owner_user_name='tempest-ServerStableDeviceRescueTest-456666962-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66625adc0c8d4508987cc570c5ae3b32',uuid=d67fcb6b-fb37-4d04-8dab-d74370f76981,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "vif_mac": "fa:16:3e:64:63:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Converting VIF {"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "vif_mac": "fa:16:3e:64:63:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:63:b2,bridge_name='br-int',has_traffic_filtering=True,id=8e91bea0-dea9-49f6-ac95-f485a29d5cd2,network=Network(44e91adc-ee33-4228-8854-2883d4950214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e91bea0-de') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'pci_devices' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.objects.base [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Object Instance<d67fcb6b-fb37-4d04-8dab-d74370f76981> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:36:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:36:39 user nova-compute[75239]:   <uuid>d67fcb6b-fb37-4d04-8dab-d74370f76981</uuid>
Nov 13 20:36:39 user nova-compute[75239]:   <name>instance-00000005</name>
Nov 13 20:36:39 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:36:39 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:36:39 user nova-compute[75239]:   <metadata>
Nov 13 20:36:39 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:36:39 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:36:39 user nova-compute[75239]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-616704806</nova:name>
Nov 13 20:36:39 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:36:39</nova:creationTime>
Nov 13 20:36:39 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:36:39 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:36:39 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:36:39 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:36:39 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:36:39 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:36:39 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:36:39 user nova-compute[75239]:       <nova:owner>
Nov 13 20:36:39 user nova-compute[75239]:         <nova:user uuid="66625adc0c8d4508987cc570c5ae3b32">tempest-ServerStableDeviceRescueTest-456666962-project-member</nova:user>
Nov 13 20:36:39 user nova-compute[75239]:         <nova:project uuid="ce07a49816064edfbf14f89b5895e9e5">tempest-ServerStableDeviceRescueTest-456666962</nova:project>
Nov 13 20:36:39 user nova-compute[75239]:       </nova:owner>
Nov 13 20:36:39 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:36:39 user nova-compute[75239]:       <nova:ports>
Nov 13 20:36:39 user nova-compute[75239]:         <nova:port uuid="8e91bea0-dea9-49f6-ac95-f485a29d5cd2">
Nov 13 20:36:39 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 20:36:39 user nova-compute[75239]:         </nova:port>
Nov 13 20:36:39 user nova-compute[75239]:       </nova:ports>
Nov 13 20:36:39 user nova-compute[75239]:     </nova:instance>
Nov 13 20:36:39 user nova-compute[75239]:   </metadata>
Nov 13 20:36:39 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:36:39 user nova-compute[75239]:     <system>
Nov 13 20:36:39 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:36:39 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:36:39 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:36:39 user nova-compute[75239]:       <entry name="serial">d67fcb6b-fb37-4d04-8dab-d74370f76981</entry>
Nov 13 20:36:39 user nova-compute[75239]:       <entry name="uuid">d67fcb6b-fb37-4d04-8dab-d74370f76981</entry>
Nov 13 20:36:39 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:36:39 user nova-compute[75239]:     </system>
Nov 13 20:36:39 user nova-compute[75239]:   </sysinfo>
Nov 13 20:36:39 user nova-compute[75239]:   <os>
Nov 13 20:36:39 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:36:39 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:36:39 user nova-compute[75239]:   </os>
Nov 13 20:36:39 user nova-compute[75239]:   <features>
Nov 13 20:36:39 user nova-compute[75239]:     <acpi/>
Nov 13 20:36:39 user nova-compute[75239]:     <apic/>
Nov 13 20:36:39 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:36:39 user nova-compute[75239]:   </features>
Nov 13 20:36:39 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:36:39 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:36:39 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:36:39 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:36:39 user nova-compute[75239]:   </clock>
Nov 13 20:36:39 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:36:39 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:36:39 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:36:39 user nova-compute[75239]:   </cpu>
Nov 13 20:36:39 user nova-compute[75239]:   <devices>
Nov 13 20:36:39 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:36:39 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:36:39 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk"/>
Nov 13 20:36:39 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:36:39 user nova-compute[75239]:     </disk>
Nov 13 20:36:39 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:36:39 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:36:39 user nova-compute[75239]:       <source dev="/dev/sdd"/>
Nov 13 20:36:39 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:36:39 user nova-compute[75239]:       <serial>00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a</serial>
Nov 13 20:36:39 user nova-compute[75239]:     </disk>
Nov 13 20:36:39 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:36:39 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:36:39 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.rescue"/>
Nov 13 20:36:39 user nova-compute[75239]:       <target dev="vdc" bus="virtio"/>
Nov 13 20:36:39 user nova-compute[75239]:       <boot order="1"/>
Nov 13 20:36:39 user nova-compute[75239]:     </disk>
Nov 13 20:36:39 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:36:39 user nova-compute[75239]:       <mac address="fa:16:3e:64:63:b2"/>
Nov 13 20:36:39 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:39 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:36:39 user nova-compute[75239]:       <target dev="tap8e91bea0-de"/>
Nov 13 20:36:39 user nova-compute[75239]:     </interface>
Nov 13 20:36:39 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:36:39 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/console.log" append="off"/>
Nov 13 20:36:39 user nova-compute[75239]:     </serial>
Nov 13 20:36:39 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:36:39 user nova-compute[75239]:     <video>
Nov 13 20:36:39 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:39 user nova-compute[75239]:     </video>
Nov 13 20:36:39 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:36:39 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:36:39 user nova-compute[75239]:     </rng>
Nov 13 20:36:39 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:36:39 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:36:39 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:36:39 user nova-compute[75239]:     </memballoon>
Nov 13 20:36:39 user nova-compute[75239]:   </devices>
Nov 13 20:36:39 user nova-compute[75239]: </domain>
Nov 13 20:36:39 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:36:39 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Instance destroyed successfully.
Nov 13 20:36:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] No VIF found with MAC fa:16:3e:64:63:b2, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Successfully updated port: 37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "refresh_cache-1fe94db5-cf69-4e80-a779-e2182588ab56" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquired lock "refresh_cache-1fe94db5-cf69-4e80-a779-e2182588ab56" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-fdd2022f-836c-4602-ae30-99b72ea01102 req-721fcfc6-d529-47a4-99ad-5a5d12ec0357 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-changed-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-fdd2022f-836c-4602-ae30-99b72ea01102 req-721fcfc6-d529-47a4-99ad-5a5d12ec0357 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Refreshing instance network info cache due to event network-changed-37dadfef-e9b8-45fe-a9f2-901e412a21d0. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fdd2022f-836c-4602-ae30-99b72ea01102 req-721fcfc6-d529-47a4-99ad-5a5d12ec0357 service nova] Acquiring lock "refresh_cache-1fe94db5-cf69-4e80-a779-e2182588ab56" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Updating instance_info_cache with network_info: [{"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Releasing lock "refresh_cache-1fe94db5-cf69-4e80-a779-e2182588ab56" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance network_info: |[{"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fdd2022f-836c-4602-ae30-99b72ea01102 req-721fcfc6-d529-47a4-99ad-5a5d12ec0357 service nova] Acquired lock "refresh_cache-1fe94db5-cf69-4e80-a779-e2182588ab56" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG nova.network.neutron [req-fdd2022f-836c-4602-ae30-99b72ea01102 req-721fcfc6-d529-47a4-99ad-5a5d12ec0357 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Refreshing network info cache for port 37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-fe37dbe4-5e47-440d-b54d-b8d6d29ae0b3 req-d120e479-0a93-492d-b98a-b36f00f91322 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe37dbe4-5e47-440d-b54d-b8d6d29ae0b3 req-d120e479-0a93-492d-b98a-b36f00f91322 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe37dbe4-5e47-440d-b54d-b8d6d29ae0b3 req-d120e479-0a93-492d-b98a-b36f00f91322 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe37dbe4-5e47-440d-b54d-b8d6d29ae0b3 req-d120e479-0a93-492d-b98a-b36f00f91322 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-fe37dbe4-5e47-440d-b54d-b8d6d29ae0b3 req-d120e479-0a93-492d-b98a-b36f00f91322 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:41 user nova-compute[75239]: WARNING nova.compute.manager [req-fe37dbe4-5e47-440d-b54d-b8d6d29ae0b3 req-d120e479-0a93-492d-b98a-b36f00f91322 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state active and task_state rescuing.
Nov 13 20:36:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-fdd2022f-836c-4602-ae30-99b72ea01102 req-721fcfc6-d529-47a4-99ad-5a5d12ec0357 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Updated VIF entry in instance network info cache for port 37dadfef-e9b8-45fe-a9f2-901e412a21d0. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:36:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-fdd2022f-836c-4602-ae30-99b72ea01102 req-721fcfc6-d529-47a4-99ad-5a5d12ec0357 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Updating instance_info_cache with network_info: [{"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fdd2022f-836c-4602-ae30-99b72ea01102 req-721fcfc6-d529-47a4-99ad-5a5d12ec0357 service nova] Releasing lock "refresh_cache-1fe94db5-cf69-4e80-a779-e2182588ab56" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:36:43 user nova-compute[75239]: INFO nova.compute.claims [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Claim successful on node user
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-724c6e4b-3c66-4c53-9c3e-813afbfdde03 req-c072be29-d938-4830-891f-58f6d863a36f service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-724c6e4b-3c66-4c53-9c3e-813afbfdde03 req-c072be29-d938-4830-891f-58f6d863a36f service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-724c6e4b-3c66-4c53-9c3e-813afbfdde03 req-c072be29-d938-4830-891f-58f6d863a36f service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-724c6e4b-3c66-4c53-9c3e-813afbfdde03 req-c072be29-d938-4830-891f-58f6d863a36f service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-724c6e4b-3c66-4c53-9c3e-813afbfdde03 req-c072be29-d938-4830-891f-58f6d863a36f service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:43 user nova-compute[75239]: WARNING nova.compute.manager [req-724c6e4b-3c66-4c53-9c3e-813afbfdde03 req-c072be29-d938-4830-891f-58f6d863a36f service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state active and task_state rescuing.
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:36:43 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:36:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.policy [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b27083a4000d4ba2832a394b9140b530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41532512e3494bfd9051c340c2557bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:36:44 user nova-compute[75239]: INFO nova.compute.claims [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Claim successful on node user
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:36:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Creating image(s)
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-e87da494-b27f-4851-af61-a3b42256defc tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:36:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Creating image(s)
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Ensure instance console log exists: /opt/stack/data/nova/instances/1fe94db5-cf69-4e80-a779-e2182588ab56/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Start _get_guest_xml network_info=[{"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '892a3f8d-b6c9-4752-b4ee-8ae63d292d94', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzyCURQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fe94db5-cf69-4e80-a779-e2182588ab56', 'attached_at': '', 'detached_at': '', 'volume_id': '1faa23e0-a730-43ba-9425-eca3b7105d2f', 'serial': '1faa23e0-a730-43ba-9425-eca3b7105d2f'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:36:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzyCURQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:36:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:36:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:36:44 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ef8cd-7846-4b31-ae07-d51c29a12364]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:36:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.214s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Successfully created port: b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e01e9d1-737d-4322-8f86-7fe1ee4281b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f] added
Nov 13 20:36:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk 1073741824" returned: 0 in 0.067s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f9988f-592c-4a75-8ee2-f95099631b9a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f209046-8d94-455a-808d-dd87a20500b0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzyCURQb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzyCURQb" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09f6741-5ac2-42ce-ab60-ff817fc27174]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzyCURQb'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a3b3f7-58a5-45a3-b799-0275be640ebc]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1615d84e-9fd7-4b55-86f2-1d2dc66e7862]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:44 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:44 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:36:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:44 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:44 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:36:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aa6d11-4a37-4e23-98b3-22381a4a566f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260]
Nov 13 20:36:44 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260] successful.
Nov 13 20:36:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33d2e70-c96f-451c-bc05-ea0c54de9c12]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:36:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[91312adb-a0b1-41fa-9327-0706a3dc870b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:45 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:45 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:36:45 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:36:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:36:45 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:36:45 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:36:45 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:36:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eff4d7-3cc2-4c10-8deb-bbebfa99ba33]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzyCURQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Cannot resize image /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Ensure instance console log exists: /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.962s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:36:45 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.policy [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b27083a4000d4ba2832a394b9140b530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41532512e3494bfd9051c340c2557bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:36:45 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Creating image(s)
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Successfully updated port: b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquired lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-8abcc5be-6450-4481-a045-bffca1a2542f req-1d12b89a-a100-454a-a6d8-886fafee3588 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-changed-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-8abcc5be-6450-4481-a045-bffca1a2542f req-1d12b89a-a100-454a-a6d8-886fafee3588 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Refreshing instance network info cache due to event network-changed-b2ae89b4-c188-415f-96da-bb22e699bc22. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8abcc5be-6450-4481-a045-bffca1a2542f req-1d12b89a-a100-454a-a6d8-886fafee3588 service nova] Acquiring lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk 1073741824" returned: 0 in 0.049s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.482s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23339353933396131', 'path': '/dev/sde'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339353933396131', 'path': '/dev/sde'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.195s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-80459434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-80459434',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4bTkMByBBN86gQLJ0njqwBvWR0XDRjrFeM5rsfRs/jEsAUVgdGRCe/qEZj7jheAmcMs60nSNIENVVJ15Le3mNrjiOZ1ooTGgvR6HWSRyk2+0hsYobO++zcjvL8uksDpg==',key_name='tempest-keypair-1832288825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='100038f3462149338c8baaefb89970e5',ramdisk_id='',reservation_id='r-cyw07hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-403999266',owner_user_name='tempest-ServerActionsV293TestJSON-403999266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0adecc32b22a4d7a910320d9f6c4f2ee',uuid=1fe94db5-cf69-4e80-a779-e2182588ab56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converting VIF {"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.objects.instance [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fe94db5-cf69-4e80-a779-e2182588ab56 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:36:46 user nova-compute[75239]:   <uuid>1fe94db5-cf69-4e80-a779-e2182588ab56</uuid>
Nov 13 20:36:46 user nova-compute[75239]:   <name>instance-00000010</name>
Nov 13 20:36:46 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:36:46 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:36:46 user nova-compute[75239]:   <metadata>
Nov 13 20:36:46 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:36:46 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:name>tempest-ServerActionsV293TestJSON-server-80459434</nova:name>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:36:44</nova:creationTime>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:36:46 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:36:46 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:owner>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:user uuid="0adecc32b22a4d7a910320d9f6c4f2ee">tempest-ServerActionsV293TestJSON-403999266-project-member</nova:user>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:project uuid="100038f3462149338c8baaefb89970e5">tempest-ServerActionsV293TestJSON-403999266</nova:project>
Nov 13 20:36:46 user nova-compute[75239]:       </nova:owner>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:ports>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:port uuid="37dadfef-e9b8-45fe-a9f2-901e412a21d0">
Nov 13 20:36:46 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 20:36:46 user nova-compute[75239]:         </nova:port>
Nov 13 20:36:46 user nova-compute[75239]:       </nova:ports>
Nov 13 20:36:46 user nova-compute[75239]:     </nova:instance>
Nov 13 20:36:46 user nova-compute[75239]:   </metadata>
Nov 13 20:36:46 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:36:46 user nova-compute[75239]:     <system>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="serial">1fe94db5-cf69-4e80-a779-e2182588ab56</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="uuid">1fe94db5-cf69-4e80-a779-e2182588ab56</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:36:46 user nova-compute[75239]:     </system>
Nov 13 20:36:46 user nova-compute[75239]:   </sysinfo>
Nov 13 20:36:46 user nova-compute[75239]:   <os>
Nov 13 20:36:46 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:36:46 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:36:46 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:36:46 user nova-compute[75239]:   </os>
Nov 13 20:36:46 user nova-compute[75239]:   <features>
Nov 13 20:36:46 user nova-compute[75239]:     <acpi/>
Nov 13 20:36:46 user nova-compute[75239]:     <apic/>
Nov 13 20:36:46 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:36:46 user nova-compute[75239]:   </features>
Nov 13 20:36:46 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:36:46 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:36:46 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:36:46 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:36:46 user nova-compute[75239]:   </clock>
Nov 13 20:36:46 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:36:46 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:36:46 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:36:46 user nova-compute[75239]:   </cpu>
Nov 13 20:36:46 user nova-compute[75239]:   <devices>
Nov 13 20:36:46 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:36:46 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:36:46 user nova-compute[75239]:       <source dev="/dev/sde"/>
Nov 13 20:36:46 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:36:46 user nova-compute[75239]:       <serial>1faa23e0-a730-43ba-9425-eca3b7105d2f</serial>
Nov 13 20:36:46 user nova-compute[75239]:     </disk>
Nov 13 20:36:46 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:36:46 user nova-compute[75239]:       <mac address="fa:16:3e:a4:19:fe"/>
Nov 13 20:36:46 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:46 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:36:46 user nova-compute[75239]:       <target dev="tap37dadfef-e9"/>
Nov 13 20:36:46 user nova-compute[75239]:     </interface>
Nov 13 20:36:46 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:36:46 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/1fe94db5-cf69-4e80-a779-e2182588ab56/console.log" append="off"/>
Nov 13 20:36:46 user nova-compute[75239]:     </serial>
Nov 13 20:36:46 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:36:46 user nova-compute[75239]:     <video>
Nov 13 20:36:46 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:46 user nova-compute[75239]:     </video>
Nov 13 20:36:46 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:36:46 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:36:46 user nova-compute[75239]:     </rng>
Nov 13 20:36:46 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:36:46 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:36:46 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:36:46 user nova-compute[75239]:     </memballoon>
Nov 13 20:36:46 user nova-compute[75239]:   </devices>
Nov 13 20:36:46 user nova-compute[75239]: </domain>
Nov 13 20:36:46 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-80459434',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-80459434',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4bTkMByBBN86gQLJ0njqwBvWR0XDRjrFeM5rsfRs/jEsAUVgdGRCe/qEZj7jheAmcMs60nSNIENVVJ15Le3mNrjiOZ1ooTGgvR6HWSRyk2+0hsYobO++zcjvL8uksDpg==',key_name='tempest-keypair-1832288825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='100038f3462149338c8baaefb89970e5',ramdisk_id='',reservation_id='r-cyw07hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-403999266',owner_user_name='tempest-ServerActionsV293TestJSON-403999266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0adecc32b22a4d7a910320d9f6c4f2ee',uuid=1fe94db5-cf69-4e80-a779-e2182588ab56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converting VIF {"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG os_vif [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27684dbd-0606-5f9e-a15c-4894f84f2cbd', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37dadfef-e9, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37dadfef-e9, col_values=(('qos', UUID('2c63c173-c99c-4207-a853-01e7047c496b')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37dadfef-e9, col_values=(('external_ids', {'iface-id': '37dadfef-e9b8-45fe-a9f2-901e412a21d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:19:fe', 'vm-uuid': '1fe94db5-cf69-4e80-a779-e2182588ab56'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: INFO os_vif [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9')
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Successfully created port: 480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] No VIF found with MAC fa:16:3e:a4:19:fe, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updating instance_info_cache with network_info: [{"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Cannot resize image /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Ensure instance console log exists: /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Releasing lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Instance network_info: |[{"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8abcc5be-6450-4481-a045-bffca1a2542f req-1d12b89a-a100-454a-a6d8-886fafee3588 service nova] Acquired lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.neutron [req-8abcc5be-6450-4481-a045-bffca1a2542f req-1d12b89a-a100-454a-a6d8-886fafee3588 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Refreshing network info cache for port b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Start _get_guest_xml network_info=[{"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:36:46 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:46 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-760259817',display_name='tempest-ServerRescueNegativeTestJSON-server-760259817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-760259817',id=17,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-n3bmobey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:44Z,user_data=None,user_id='b27083a4000d4ba2832a394b9140b530',uuid=4ca1da31-616b-4f78-b50b-6e58d8d70974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=b2ae89b4-c188-415f-96da-bb22e699bc22,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ae89b4-c1') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.objects.instance [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:36:46 user nova-compute[75239]:   <uuid>4ca1da31-616b-4f78-b50b-6e58d8d70974</uuid>
Nov 13 20:36:46 user nova-compute[75239]:   <name>instance-00000011</name>
Nov 13 20:36:46 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:36:46 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:36:46 user nova-compute[75239]:   <metadata>
Nov 13 20:36:46 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:36:46 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-760259817</nova:name>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:36:46</nova:creationTime>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:36:46 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:36:46 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:owner>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:user uuid="b27083a4000d4ba2832a394b9140b530">tempest-ServerRescueNegativeTestJSON-1212200086-project-member</nova:user>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:project uuid="41532512e3494bfd9051c340c2557bfe">tempest-ServerRescueNegativeTestJSON-1212200086</nova:project>
Nov 13 20:36:46 user nova-compute[75239]:       </nova:owner>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:36:46 user nova-compute[75239]:       <nova:ports>
Nov 13 20:36:46 user nova-compute[75239]:         <nova:port uuid="b2ae89b4-c188-415f-96da-bb22e699bc22">
Nov 13 20:36:46 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:36:46 user nova-compute[75239]:         </nova:port>
Nov 13 20:36:46 user nova-compute[75239]:       </nova:ports>
Nov 13 20:36:46 user nova-compute[75239]:     </nova:instance>
Nov 13 20:36:46 user nova-compute[75239]:   </metadata>
Nov 13 20:36:46 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:36:46 user nova-compute[75239]:     <system>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="serial">4ca1da31-616b-4f78-b50b-6e58d8d70974</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="uuid">4ca1da31-616b-4f78-b50b-6e58d8d70974</entry>
Nov 13 20:36:46 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:36:46 user nova-compute[75239]:     </system>
Nov 13 20:36:46 user nova-compute[75239]:   </sysinfo>
Nov 13 20:36:46 user nova-compute[75239]:   <os>
Nov 13 20:36:46 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:36:46 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:36:46 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:36:46 user nova-compute[75239]:   </os>
Nov 13 20:36:46 user nova-compute[75239]:   <features>
Nov 13 20:36:46 user nova-compute[75239]:     <acpi/>
Nov 13 20:36:46 user nova-compute[75239]:     <apic/>
Nov 13 20:36:46 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:36:46 user nova-compute[75239]:   </features>
Nov 13 20:36:46 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:36:46 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:36:46 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:36:46 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:36:46 user nova-compute[75239]:   </clock>
Nov 13 20:36:46 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:36:46 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:36:46 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:36:46 user nova-compute[75239]:   </cpu>
Nov 13 20:36:46 user nova-compute[75239]:   <devices>
Nov 13 20:36:46 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:36:46 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:36:46 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk"/>
Nov 13 20:36:46 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:36:46 user nova-compute[75239]:     </disk>
Nov 13 20:36:46 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:36:46 user nova-compute[75239]:       <mac address="fa:16:3e:1b:ec:16"/>
Nov 13 20:36:46 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:46 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:36:46 user nova-compute[75239]:       <target dev="tapb2ae89b4-c1"/>
Nov 13 20:36:46 user nova-compute[75239]:     </interface>
Nov 13 20:36:46 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:36:46 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/console.log" append="off"/>
Nov 13 20:36:46 user nova-compute[75239]:     </serial>
Nov 13 20:36:46 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:36:46 user nova-compute[75239]:     <video>
Nov 13 20:36:46 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:46 user nova-compute[75239]:     </video>
Nov 13 20:36:46 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:36:46 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:36:46 user nova-compute[75239]:     </rng>
Nov 13 20:36:46 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:36:46 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:36:46 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:36:46 user nova-compute[75239]:     </memballoon>
Nov 13 20:36:46 user nova-compute[75239]:   </devices>
Nov 13 20:36:46 user nova-compute[75239]: </domain>
Nov 13 20:36:46 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-760259817',display_name='tempest-ServerRescueNegativeTestJSON-server-760259817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-760259817',id=17,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-n3bmobey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:44Z,user_data=None,user_id='b27083a4000d4ba2832a394b9140b530',uuid=4ca1da31-616b-4f78-b50b-6e58d8d70974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=b2ae89b4-c188-415f-96da-bb22e699bc22,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ae89b4-c1') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG os_vif [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=b2ae89b4-c188-415f-96da-bb22e699bc22,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ae89b4-c1') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21ad2c82-a906-55cc-8946-1f56733d4a32', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2ae89b4-c1, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2ae89b4-c1, col_values=(('qos', UUID('3dc73691-a869-4acf-b3cd-6c0d1471ac5d')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2ae89b4-c1, col_values=(('external_ids', {'iface-id': 'b2ae89b4-c188-415f-96da-bb22e699bc22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:ec:16', 'vm-uuid': '4ca1da31-616b-4f78-b50b-6e58d8d70974'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:46 user nova-compute[75239]: INFO os_vif [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=b2ae89b4-c188-415f-96da-bb22e699bc22,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ae89b4-c1')
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No VIF found with MAC fa:16:3e:1b:ec:16, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.neutron [req-8abcc5be-6450-4481-a045-bffca1a2542f req-1d12b89a-a100-454a-a6d8-886fafee3588 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updated VIF entry in instance network info cache for port b2ae89b4-c188-415f-96da-bb22e699bc22. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG nova.network.neutron [req-8abcc5be-6450-4481-a045-bffca1a2542f req-1d12b89a-a100-454a-a6d8-886fafee3588 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updating instance_info_cache with network_info: [{"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8abcc5be-6450-4481-a045-bffca1a2542f req-1d12b89a-a100-454a-a6d8-886fafee3588 service nova] Releasing lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.network.neutron [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Successfully updated port: 480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquired lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.network.neutron [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.network.neutron [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.network.neutron [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updating instance_info_cache with network_info: [{"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Releasing lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Instance network_info: |[{"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Start _get_guest_xml network_info=[{"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:36:47 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:47 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355998343',display_name='tempest-ServerRescueNegativeTestJSON-server-1355998343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355998343',id=18,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-rx1jyauh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:45Z,user_data=None,user_id='b27083a4000d4ba2832a394b9140b530',uuid=3cbf6e73-bc09-4e1f-b249-261f0534c6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5d:ad,bridge_name='br-int',has_traffic_filtering=True,id=480fb2da-ad24-40ae-8586-d9050eca6899,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480fb2da-ad') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.objects.instance [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:36:47 user nova-compute[75239]:   <uuid>3cbf6e73-bc09-4e1f-b249-261f0534c6e0</uuid>
Nov 13 20:36:47 user nova-compute[75239]:   <name>instance-00000012</name>
Nov 13 20:36:47 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:36:47 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:36:47 user nova-compute[75239]:   <metadata>
Nov 13 20:36:47 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:36:47 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:36:47 user nova-compute[75239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1355998343</nova:name>
Nov 13 20:36:47 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:36:47</nova:creationTime>
Nov 13 20:36:47 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:36:47 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:36:47 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:36:47 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:36:47 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:36:47 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:36:47 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:36:47 user nova-compute[75239]:       <nova:owner>
Nov 13 20:36:47 user nova-compute[75239]:         <nova:user uuid="b27083a4000d4ba2832a394b9140b530">tempest-ServerRescueNegativeTestJSON-1212200086-project-member</nova:user>
Nov 13 20:36:47 user nova-compute[75239]:         <nova:project uuid="41532512e3494bfd9051c340c2557bfe">tempest-ServerRescueNegativeTestJSON-1212200086</nova:project>
Nov 13 20:36:47 user nova-compute[75239]:       </nova:owner>
Nov 13 20:36:47 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:36:47 user nova-compute[75239]:       <nova:ports>
Nov 13 20:36:47 user nova-compute[75239]:         <nova:port uuid="480fb2da-ad24-40ae-8586-d9050eca6899">
Nov 13 20:36:47 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 20:36:47 user nova-compute[75239]:         </nova:port>
Nov 13 20:36:47 user nova-compute[75239]:       </nova:ports>
Nov 13 20:36:47 user nova-compute[75239]:     </nova:instance>
Nov 13 20:36:47 user nova-compute[75239]:   </metadata>
Nov 13 20:36:47 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:36:47 user nova-compute[75239]:     <system>
Nov 13 20:36:47 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:36:47 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:36:47 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:36:47 user nova-compute[75239]:       <entry name="serial">3cbf6e73-bc09-4e1f-b249-261f0534c6e0</entry>
Nov 13 20:36:47 user nova-compute[75239]:       <entry name="uuid">3cbf6e73-bc09-4e1f-b249-261f0534c6e0</entry>
Nov 13 20:36:47 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:36:47 user nova-compute[75239]:     </system>
Nov 13 20:36:47 user nova-compute[75239]:   </sysinfo>
Nov 13 20:36:47 user nova-compute[75239]:   <os>
Nov 13 20:36:47 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:36:47 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:36:47 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:36:47 user nova-compute[75239]:   </os>
Nov 13 20:36:47 user nova-compute[75239]:   <features>
Nov 13 20:36:47 user nova-compute[75239]:     <acpi/>
Nov 13 20:36:47 user nova-compute[75239]:     <apic/>
Nov 13 20:36:47 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:36:47 user nova-compute[75239]:   </features>
Nov 13 20:36:47 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:36:47 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:36:47 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:36:47 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:36:47 user nova-compute[75239]:   </clock>
Nov 13 20:36:47 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:36:47 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:36:47 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:36:47 user nova-compute[75239]:   </cpu>
Nov 13 20:36:47 user nova-compute[75239]:   <devices>
Nov 13 20:36:47 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:36:47 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:36:47 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk"/>
Nov 13 20:36:47 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:36:47 user nova-compute[75239]:     </disk>
Nov 13 20:36:47 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:36:47 user nova-compute[75239]:       <mac address="fa:16:3e:e5:5d:ad"/>
Nov 13 20:36:47 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:47 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:36:47 user nova-compute[75239]:       <target dev="tap480fb2da-ad"/>
Nov 13 20:36:47 user nova-compute[75239]:     </interface>
Nov 13 20:36:47 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:36:47 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/console.log" append="off"/>
Nov 13 20:36:47 user nova-compute[75239]:     </serial>
Nov 13 20:36:47 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:36:47 user nova-compute[75239]:     <video>
Nov 13 20:36:47 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:36:47 user nova-compute[75239]:     </video>
Nov 13 20:36:47 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:36:47 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:36:47 user nova-compute[75239]:     </rng>
Nov 13 20:36:47 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:36:47 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:36:47 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:36:47 user nova-compute[75239]:     </memballoon>
Nov 13 20:36:47 user nova-compute[75239]:   </devices>
Nov 13 20:36:47 user nova-compute[75239]: </domain>
Nov 13 20:36:47 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355998343',display_name='tempest-ServerRescueNegativeTestJSON-server-1355998343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355998343',id=18,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-rx1jyauh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:45Z,user_data=None,user_id='b27083a4000d4ba2832a394b9140b530',uuid=3cbf6e73-bc09-4e1f-b249-261f0534c6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5d:ad,bridge_name='br-int',has_traffic_filtering=True,id=480fb2da-ad24-40ae-8586-d9050eca6899,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480fb2da-ad') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG os_vif [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5d:ad,bridge_name='br-int',has_traffic_filtering=True,id=480fb2da-ad24-40ae-8586-d9050eca6899,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480fb2da-ad') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5ab80354-b19e-5c32-bd1b-d755d5ba7805', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap480fb2da-ad, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap480fb2da-ad, col_values=(('qos', UUID('853be5a8-a1b9-4135-a0b6-7446ba32ff07')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap480fb2da-ad, col_values=(('external_ids', {'iface-id': '480fb2da-ad24-40ae-8586-d9050eca6899', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:5d:ad', 'vm-uuid': '3cbf6e73-bc09-4e1f-b249-261f0534c6e0'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-1a76fd47-9c53-4308-8143-458dff03588f req-730f2dbb-21ff-4440-aab6-c0b36e851d9c service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-changed-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-1a76fd47-9c53-4308-8143-458dff03588f req-730f2dbb-21ff-4440-aab6-c0b36e851d9c service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Refreshing instance network info cache due to event network-changed-480fb2da-ad24-40ae-8586-d9050eca6899. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a76fd47-9c53-4308-8143-458dff03588f req-730f2dbb-21ff-4440-aab6-c0b36e851d9c service nova] Acquiring lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a76fd47-9c53-4308-8143-458dff03588f req-730f2dbb-21ff-4440-aab6-c0b36e851d9c service nova] Acquired lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-1a76fd47-9c53-4308-8143-458dff03588f req-730f2dbb-21ff-4440-aab6-c0b36e851d9c service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Refreshing network info cache for port 480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:47 user nova-compute[75239]: INFO os_vif [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:5d:ad,bridge_name='br-int',has_traffic_filtering=True,id=480fb2da-ad24-40ae-8586-d9050eca6899,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480fb2da-ad')
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:36:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No VIF found with MAC fa:16:3e:e5:5d:ad, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:36:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-1a76fd47-9c53-4308-8143-458dff03588f req-730f2dbb-21ff-4440-aab6-c0b36e851d9c service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updated VIF entry in instance network info cache for port 480fb2da-ad24-40ae-8586-d9050eca6899. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:36:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-1a76fd47-9c53-4308-8143-458dff03588f req-730f2dbb-21ff-4440-aab6-c0b36e851d9c service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updating instance_info_cache with network_info: [{"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:36:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1a76fd47-9c53-4308-8143-458dff03588f req-730f2dbb-21ff-4440-aab6-c0b36e851d9c service nova] Releasing lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-20a15f98-a1f4-4873-b653-617b6376c151 req-a5fdba8b-90e7-4375-8e92-7199c5020cf4 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-20a15f98-a1f4-4873-b653-617b6376c151 req-a5fdba8b-90e7-4375-8e92-7199c5020cf4 service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-20a15f98-a1f4-4873-b653-617b6376c151 req-a5fdba8b-90e7-4375-8e92-7199c5020cf4 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-20a15f98-a1f4-4873-b653-617b6376c151 req-a5fdba8b-90e7-4375-8e92-7199c5020cf4 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-20a15f98-a1f4-4873-b653-617b6376c151 req-a5fdba8b-90e7-4375-8e92-7199c5020cf4 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:49 user nova-compute[75239]: WARNING nova.compute.manager [req-20a15f98-a1f4-4873-b653-617b6376c151 req-a5fdba8b-90e7-4375-8e92-7199c5020cf4 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state building and task_state spawning.
Nov 13 20:36:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-e7ec9188-8a79-43d7-b2ef-6d982b386531 req-8d2d947e-e550-4b85-ad36-fdffe0b83885 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e7ec9188-8a79-43d7-b2ef-6d982b386531 req-8d2d947e-e550-4b85-ad36-fdffe0b83885 service nova] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e7ec9188-8a79-43d7-b2ef-6d982b386531 req-8d2d947e-e550-4b85-ad36-fdffe0b83885 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e7ec9188-8a79-43d7-b2ef-6d982b386531 req-8d2d947e-e550-4b85-ad36-fdffe0b83885 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-e7ec9188-8a79-43d7-b2ef-6d982b386531 req-8d2d947e-e550-4b85-ad36-fdffe0b83885 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] No waiting events found dispatching network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:50 user nova-compute[75239]: WARNING nova.compute.manager [req-e7ec9188-8a79-43d7-b2ef-6d982b386531 req-8d2d947e-e550-4b85-ad36-fdffe0b83885 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received unexpected event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 for instance with vm_state building and task_state spawning.
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:51 user nova-compute[75239]: WARNING nova.compute.manager [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state building and task_state spawning.
Nov 13 20:36:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:51 user nova-compute[75239]: WARNING nova.compute.manager [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state building and task_state spawning.
Nov 13 20:36:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:51 user nova-compute[75239]: WARNING nova.compute.manager [req-7fb3b3e4-eccc-406f-a78c-67eabc85f80f req-07933e50-005f-4686-ae9b-7c5337a44f72 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state building and task_state spawning.
Nov 13 20:36:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-fc21cacc-f615-4e62-8758-4ec921c264c3 req-3b37df55-c580-4696-9616-260c5b79bbb0 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:36:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fc21cacc-f615-4e62-8758-4ec921c264c3 req-3b37df55-c580-4696-9616-260c5b79bbb0 service nova] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:36:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fc21cacc-f615-4e62-8758-4ec921c264c3 req-3b37df55-c580-4696-9616-260c5b79bbb0 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:36:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fc21cacc-f615-4e62-8758-4ec921c264c3 req-3b37df55-c580-4696-9616-260c5b79bbb0 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-fc21cacc-f615-4e62-8758-4ec921c264c3 req-3b37df55-c580-4696-9616-260c5b79bbb0 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] No waiting events found dispatching network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:36:52 user nova-compute[75239]: WARNING nova.compute.manager [req-fc21cacc-f615-4e62-8758-4ec921c264c3 req-3b37df55-c580-4696-9616-260c5b79bbb0 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received unexpected event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 for instance with vm_state building and task_state spawning.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:36:53 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Instance spawned successfully.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:36:53 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance spawned successfully.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:36:53 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Instance spawned successfully.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:36:53 user nova-compute[75239]: INFO nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Took 9.21 seconds to spawn the instance on the hypervisor.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:36:53 user nova-compute[75239]: INFO nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Took 9.01 seconds to spawn the instance on the hypervisor.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:36:53 user nova-compute[75239]: INFO nova.compute.manager [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Took 10.31 seconds to build instance.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-06a3f70c-ece6-4d7f-87f6-5240d2b66830 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.441s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:53 user nova-compute[75239]: INFO nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Took 8.13 seconds to spawn the instance on the hypervisor.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:36:53 user nova-compute[75239]: INFO nova.compute.manager [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Took 16.98 seconds to build instance.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-37e32df2-3f21-4822-a9e4-1a0886c1c6d0 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.169s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:53 user nova-compute[75239]: INFO nova.compute.manager [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Took 9.52 seconds to build instance.
Nov 13 20:36:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3fe4f5a1-d815-474c-baea-f7f83d15f905 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.722s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:36:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:36:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:19 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:37:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:37:19 user nova-compute[75239]: INFO nova.compute.claims [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Claim successful on node user
Nov 13 20:37:20 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG nova.network.neutron [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:37:20 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:37:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG nova.policy [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '297728d5d4c4454a9f9acd594d24b232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd292feb205994cddb6f2765da53fee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:37:20 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Creating image(s)
Nov 13 20:37:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "/opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "/opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.212s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.206s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk 1073741824" returned: 0 in 0.058s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG nova.network.neutron [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Successfully created port: 3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Cannot resize image /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Ensure instance console log exists: /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Successfully updated port: 3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquired lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f987e82-9084-4945-a09e-3ecc0440aa4c req-f2957757-92da-4ee6-a710-10ca89aca1b2 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received event network-changed-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f987e82-9084-4945-a09e-3ecc0440aa4c req-f2957757-92da-4ee6-a710-10ca89aca1b2 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Refreshing instance network info cache due to event network-changed-3a120adc-128c-4dba-aab5-c23fd9ee017d. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f987e82-9084-4945-a09e-3ecc0440aa4c req-f2957757-92da-4ee6-a710-10ca89aca1b2 service nova] Acquiring lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.network.neutron [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Updating instance_info_cache with network_info: [{"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Releasing lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Instance network_info: |[{"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f987e82-9084-4945-a09e-3ecc0440aa4c req-f2957757-92da-4ee6-a710-10ca89aca1b2 service nova] Acquired lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-8f987e82-9084-4945-a09e-3ecc0440aa4c req-f2957757-92da-4ee6-a710-10ca89aca1b2 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Refreshing network info cache for port 3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Start _get_guest_xml network_info=[{"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:37:23 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:37:23 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1722150779',display_name='tempest-TestStampPattern-server-1722150779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1722150779',id=19,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsJkUh8tzjbwjGz2z/FPh6VoEoc5eNHl/mHpg0AYJPwTCL8t4LK5SGwpvdKX8mICr9zRERa/UEuI0kQJy2b6EW0qfB+fmIFb5tJy6989x+nGNRdNksl6VWF1E+4Wj6iBQ==',key_name='tempest-TestStampPattern-1567089186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d292feb205994cddb6f2765da53fee90',ramdisk_id='',reservation_id='r-vl30rnjx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1429319310',owner_user_name='tempest-TestStampPattern-1429319310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:21Z,user_data=None,user_id='297728d5d4c4454a9f9acd594d24b232',uuid=1ec27628-db61-49c0-951b-6e72ac2f4f15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converting VIF {"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:03:ba,bridge_name='br-int',has_traffic_filtering=True,id=3a120adc-128c-4dba-aab5-c23fd9ee017d,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a120adc-12') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.objects.instance [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ec27628-db61-49c0-951b-6e72ac2f4f15 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:37:23 user nova-compute[75239]:   <uuid>1ec27628-db61-49c0-951b-6e72ac2f4f15</uuid>
Nov 13 20:37:23 user nova-compute[75239]:   <name>instance-00000013</name>
Nov 13 20:37:23 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:37:23 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:37:23 user nova-compute[75239]:   <metadata>
Nov 13 20:37:23 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:37:23 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:37:23 user nova-compute[75239]:       <nova:name>tempest-TestStampPattern-server-1722150779</nova:name>
Nov 13 20:37:23 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:37:23</nova:creationTime>
Nov 13 20:37:23 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:37:23 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:37:23 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:37:23 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:37:23 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:37:23 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:37:23 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:37:23 user nova-compute[75239]:       <nova:owner>
Nov 13 20:37:23 user nova-compute[75239]:         <nova:user uuid="297728d5d4c4454a9f9acd594d24b232">tempest-TestStampPattern-1429319310-project-member</nova:user>
Nov 13 20:37:23 user nova-compute[75239]:         <nova:project uuid="d292feb205994cddb6f2765da53fee90">tempest-TestStampPattern-1429319310</nova:project>
Nov 13 20:37:23 user nova-compute[75239]:       </nova:owner>
Nov 13 20:37:23 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:37:23 user nova-compute[75239]:       <nova:ports>
Nov 13 20:37:23 user nova-compute[75239]:         <nova:port uuid="3a120adc-128c-4dba-aab5-c23fd9ee017d">
Nov 13 20:37:23 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 20:37:23 user nova-compute[75239]:         </nova:port>
Nov 13 20:37:23 user nova-compute[75239]:       </nova:ports>
Nov 13 20:37:23 user nova-compute[75239]:     </nova:instance>
Nov 13 20:37:23 user nova-compute[75239]:   </metadata>
Nov 13 20:37:23 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:37:23 user nova-compute[75239]:     <system>
Nov 13 20:37:23 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:37:23 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:37:23 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:37:23 user nova-compute[75239]:       <entry name="serial">1ec27628-db61-49c0-951b-6e72ac2f4f15</entry>
Nov 13 20:37:23 user nova-compute[75239]:       <entry name="uuid">1ec27628-db61-49c0-951b-6e72ac2f4f15</entry>
Nov 13 20:37:23 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:37:23 user nova-compute[75239]:     </system>
Nov 13 20:37:23 user nova-compute[75239]:   </sysinfo>
Nov 13 20:37:23 user nova-compute[75239]:   <os>
Nov 13 20:37:23 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:37:23 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:37:23 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:37:23 user nova-compute[75239]:   </os>
Nov 13 20:37:23 user nova-compute[75239]:   <features>
Nov 13 20:37:23 user nova-compute[75239]:     <acpi/>
Nov 13 20:37:23 user nova-compute[75239]:     <apic/>
Nov 13 20:37:23 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:37:23 user nova-compute[75239]:   </features>
Nov 13 20:37:23 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:37:23 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:37:23 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:37:23 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:37:23 user nova-compute[75239]:   </clock>
Nov 13 20:37:23 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:37:23 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:37:23 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:37:23 user nova-compute[75239]:   </cpu>
Nov 13 20:37:23 user nova-compute[75239]:   <devices>
Nov 13 20:37:23 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:37:23 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:37:23 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk"/>
Nov 13 20:37:23 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:37:23 user nova-compute[75239]:     </disk>
Nov 13 20:37:23 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:37:23 user nova-compute[75239]:       <mac address="fa:16:3e:b8:03:ba"/>
Nov 13 20:37:23 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:37:23 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:37:23 user nova-compute[75239]:       <target dev="tap3a120adc-12"/>
Nov 13 20:37:23 user nova-compute[75239]:     </interface>
Nov 13 20:37:23 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:37:23 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/console.log" append="off"/>
Nov 13 20:37:23 user nova-compute[75239]:     </serial>
Nov 13 20:37:23 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:37:23 user nova-compute[75239]:     <video>
Nov 13 20:37:23 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:37:23 user nova-compute[75239]:     </video>
Nov 13 20:37:23 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:37:23 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:37:23 user nova-compute[75239]:     </rng>
Nov 13 20:37:23 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:37:23 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:37:23 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:37:23 user nova-compute[75239]:     </memballoon>
Nov 13 20:37:23 user nova-compute[75239]:   </devices>
Nov 13 20:37:23 user nova-compute[75239]: </domain>
Nov 13 20:37:23 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1722150779',display_name='tempest-TestStampPattern-server-1722150779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1722150779',id=19,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsJkUh8tzjbwjGz2z/FPh6VoEoc5eNHl/mHpg0AYJPwTCL8t4LK5SGwpvdKX8mICr9zRERa/UEuI0kQJy2b6EW0qfB+fmIFb5tJy6989x+nGNRdNksl6VWF1E+4Wj6iBQ==',key_name='tempest-TestStampPattern-1567089186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d292feb205994cddb6f2765da53fee90',ramdisk_id='',reservation_id='r-vl30rnjx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1429319310',owner_user_name='tempest-TestStampPattern-1429319310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:21Z,user_data=None,user_id='297728d5d4c4454a9f9acd594d24b232',uuid=1ec27628-db61-49c0-951b-6e72ac2f4f15,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converting VIF {"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:03:ba,bridge_name='br-int',has_traffic_filtering=True,id=3a120adc-128c-4dba-aab5-c23fd9ee017d,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a120adc-12') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG os_vif [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:03:ba,bridge_name='br-int',has_traffic_filtering=True,id=3a120adc-128c-4dba-aab5-c23fd9ee017d,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a120adc-12') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68ce2ed4-331f-5a4a-a66c-993fe3beaa8c', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a120adc-12, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a120adc-12, col_values=(('qos', UUID('59348b24-8455-4fae-a73d-891ddf67de8c')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a120adc-12, col_values=(('external_ids', {'iface-id': '3a120adc-128c-4dba-aab5-c23fd9ee017d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:03:ba', 'vm-uuid': '1ec27628-db61-49c0-951b-6e72ac2f4f15'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:23 user nova-compute[75239]: INFO os_vif [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:03:ba,bridge_name='br-int',has_traffic_filtering=True,id=3a120adc-128c-4dba-aab5-c23fd9ee017d,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a120adc-12')
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No VIF found with MAC fa:16:3e:b8:03:ba, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-8f987e82-9084-4945-a09e-3ecc0440aa4c req-f2957757-92da-4ee6-a710-10ca89aca1b2 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Updated VIF entry in instance network info cache for port 3a120adc-128c-4dba-aab5-c23fd9ee017d. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-8f987e82-9084-4945-a09e-3ecc0440aa4c req-f2957757-92da-4ee6-a710-10ca89aca1b2 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Updating instance_info_cache with network_info: [{"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f987e82-9084-4945-a09e-3ecc0440aa4c req-f2957757-92da-4ee6-a710-10ca89aca1b2 service nova] Releasing lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-9efba718-879b-4026-90bf-d3b1842a3568 req-6ebcb7fd-23cf-42cc-a147-7765e62a4673 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received event network-vif-plugged-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9efba718-879b-4026-90bf-d3b1842a3568 req-6ebcb7fd-23cf-42cc-a147-7765e62a4673 service nova] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9efba718-879b-4026-90bf-d3b1842a3568 req-6ebcb7fd-23cf-42cc-a147-7765e62a4673 service nova] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9efba718-879b-4026-90bf-d3b1842a3568 req-6ebcb7fd-23cf-42cc-a147-7765e62a4673 service nova] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-9efba718-879b-4026-90bf-d3b1842a3568 req-6ebcb7fd-23cf-42cc-a147-7765e62a4673 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] No waiting events found dispatching network-vif-plugged-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:25 user nova-compute[75239]: WARNING nova.compute.manager [req-9efba718-879b-4026-90bf-d3b1842a3568 req-6ebcb7fd-23cf-42cc-a147-7765e62a4673 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received unexpected event network-vif-plugged-3a120adc-128c-4dba-aab5-c23fd9ee017d for instance with vm_state building and task_state spawning.
Nov 13 20:37:25 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:37:25 user nova-compute[75239]: INFO nova.compute.manager [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Rescuing
Nov 13 20:37:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquired lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updating instance_info_cache with network_info: [{"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Releasing lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance destroyed successfully.
Nov 13 20:37:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Attempting a stable device rescue
Nov 13 20:37:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 20:37:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance directory exists: not creating {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 20:37:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Creating image(s)
Nov 13 20:37:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "/opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "/opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "/opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:26 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "3c66175cdf6c624f95069611163a4acc7e34ac95" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "3c66175cdf6c624f95069611163a4acc7e34ac95" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received event network-vif-plugged-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] No waiting events found dispatching network-vif-plugged-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:28 user nova-compute[75239]: WARNING nova.compute.manager [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received unexpected event network-vif-plugged-3a120adc-128c-4dba-aab5-c23fd9ee017d for instance with vm_state building and task_state spawning.
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-changed-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Refreshing instance network info cache due to event network-changed-70460a6e-b85a-4875-94c8-fa1917a78871. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] Acquiring lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] Acquired lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Refreshing network info cache for port 70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:37:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Instance spawned successfully.
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:28 user nova-compute[75239]: INFO nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Took 7.32 seconds to spawn the instance on the hypervisor.
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95.part --force-share --output=json" returned: 0 in 0.220s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.virt.images [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] 58e6d768-e85e-45e0-aa8d-b9094b95f784 was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95.part /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:28 user nova-compute[75239]: INFO nova.compute.manager [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Took 8.59 seconds to build instance.
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5a6de1fc-6431-4032-9960-ac0257e5611e tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.735s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updated VIF entry in instance network info cache for port 70460a6e-b85a-4875-94c8-fa1917a78871. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updating instance_info_cache with network_info: [{"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95.part /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95.converted" returned: 0 in 0.465s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9a7f3c78-f62d-4812-b235-d7dea412fc45 req-cb502a27-388c-4e70-b843-f4c3c012c267 service nova] Releasing lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "3c66175cdf6c624f95069611163a4acc7e34ac95" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.190s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "3c66175cdf6c624f95069611163a4acc7e34ac95" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "3c66175cdf6c624f95069611163a4acc7e34ac95" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95 --force-share --output=json" returned: 0 in 0.199s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95,backing_fmt=raw /opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.rescue {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95,backing_fmt=raw /opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.rescue" returned: 0 in 0.068s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "3c66175cdf6c624f95069611163a4acc7e34ac95" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'migration_context' on Instance uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<1796f4bf-40b0-4a4a-85a5-3690fb761031> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Start _get_guest_xml network_info=[{"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "vif_mac": "fa:16:3e:ae:cf:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '58e6d768-e85e-45e0-aa8d-b9094b95f784', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2a1a787a-f316-43d2-95ee-d01d6c3537c3', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbyMxieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '1796f4bf-40b0-4a4a-85a5-3690fb761031', 'attached_at': '', 'detached_at': '', 'volume_id': '1e524d23-a0bd-40df-bd81-6e30dcb200ad', 'serial': '1e524d23-a0bd-40df-bd81-6e30dcb200ad'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'resources' on Instance uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<1796f4bf-40b0-4a4a-85a5-3690fb761031> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'numa_topology' on Instance uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<1796f4bf-40b0-4a4a-85a5-3690fb761031> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:37:29 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:37:29 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<1796f4bf-40b0-4a4a-85a5-3690fb761031> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbyMxieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:37:29 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:37:29 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:37:29 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[664699c7-7386-42ea-96d3-551329c3fd94]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wbyMxieG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 20:37:29 user nova-compute[75239]: node.name = iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:37:29 user nova-compute[75239]: node.tpgt = -1
Nov 13 20:37:29 user nova-compute[75239]: node.startup = automatic
Nov 13 20:37:29 user nova-compute[75239]: node.leading_login = No
Nov 13 20:37:29 user nova-compute[75239]: iface.iscsi_ifacename = default
Nov 13 20:37:29 user nova-compute[75239]: iface.net_ifacename = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.ipaddress = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.prefix_len = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.hwaddress = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.transport_name = tcp
Nov 13 20:37:29 user nova-compute[75239]: iface.initiatorname = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.state = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.vlan_id = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.vlan_priority = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.vlan_state = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.iface_num = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.mtu = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.port = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.bootproto = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.subnet_mask = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.gateway = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.dhcp_alt_client_id = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.dhcp_dns = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.dhcp_learn_iqn = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.dhcp_vendor_id_state = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.dhcp_vendor_id = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.dhcp_slp_da = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.fragmentation = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.gratuitous_arp = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.incoming_forwarding = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.tos_state = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.tos = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.ttl = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.delayed_ack = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.tcp_nagle = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.tcp_wsf_state = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.tcp_wsf = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.tcp_timer_scale = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.tcp_timestamp = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.redirect = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.def_task_mgmt_timeout = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.header_digest = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.data_digest = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.immediate_data = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.initial_r2t = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.data_seq_inorder = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.data_pdu_inorder = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.erl = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.max_receive_data_len = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.first_burst_len = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.max_outstanding_r2t = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.max_burst_len = 0
Nov 13 20:37:29 user nova-compute[75239]: iface.chap_auth = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.bidi_chap = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.strict_login_compliance = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.discovery_auth = <empty>
Nov 13 20:37:29 user nova-compute[75239]: iface.discovery_logout = <empty>
Nov 13 20:37:29 user nova-compute[75239]: node.discovery_address = <empty>
Nov 13 20:37:29 user nova-compute[75239]: node.discovery_port = 0
Nov 13 20:37:29 user nova-compute[75239]: node.discovery_type = static
Nov 13 20:37:29 user nova-compute[75239]: node.session.initial_cmdsn = 0
Nov 13 20:37:29 user nova-compute[75239]: node.session.initial_login_retry_max = 8
Nov 13 20:37:29 user nova-compute[75239]: node.session.xmit_thread_priority = -20
Nov 13 20:37:29 user nova-compute[75239]: node.session.cmds_max = 128
Nov 13 20:37:29 user nova-compute[75239]: node.session.queue_depth = 32
Nov 13 20:37:29 user nova-compute[75239]: node.session.nr_sessions = 1
Nov 13 20:37:29 user nova-compute[75239]: node.session.auth.authmethod = CHAP
Nov 13 20:37:29 user nova-compute[75239]: node.session.auth.username = wbyMxieG
Nov 13 20:37:29 user nova-compute[75239]: node.session.auth.password = ***
Nov 13 20:37:29 user nova-compute[75239]: node.session.auth.username_in = <empty>
Nov 13 20:37:29 user nova-compute[75239]: node.session.auth.password_in = <empty>
Nov 13 20:37:29 user nova-compute[75239]: node.session.auth.chap_algs = MD5
Nov 13 20:37:29 user nova-compute[75239]: node.session.timeo.replacement_timeout = 120
Nov 13 20:37:29 user nova-compute[75239]: node.session.err_timeo.abort_timeout = 15
Nov 13 20:37:29 user nova-compute[75239]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 20:37:29 user nova-compute[75239]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 20:37:29 user nova-compute[75239]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.FastAbort = Yes
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.InitialR2T = No
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.ImmediateData = Yes
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.MaxConnections = 1
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 20:37:29 user nova-compute[75239]: node.session.iscsi.ERL = 0
Nov 13 20:37:29 user nova-compute[75239]: node.session.scan = manual
Nov 13 20:37:29 user nova-compute[75239]: node.session.reopen_max = 0
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].address = 172.16.0.220
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].port = 3260
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].startup = manual
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].tcp.window_size = 524288
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].tcp.type_of_service = 0
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].timeo.logout_timeout = 15
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].timeo.login_timeout = 15
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].timeo.auth_timeout = 45
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].iscsi.DataDigest = None
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].iscsi.IFMarker = No
Nov 13 20:37:29 user nova-compute[75239]: node.conn[0].iscsi.OFMarker = No
Nov 13 20:37:29 user nova-compute[75239]: # END RECORD
Nov 13 20:37:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9cdc0a-35ff-4e2a-8f76-dd1c17fc945b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[226239ea-eb48-40fd-896a-9d1dcb87d94f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbyMxieG {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbyMxieG" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d6aaa7-0f68-44cc-86b3-8a85d0678899]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wbyMxieG'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0701143-0de0-404c-9333-8ec7dbb79785]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e2017-60f0-4cae-b754-08bacd0cead5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:37:29 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:37:29 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:37:29 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:37:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:37:29 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:37:29 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:37:29 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:37:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.193s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d040042-78e2-4653-be45-2b4f75ad3db1]: (4, ('0 0 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbyMxieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.249s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] <== connect_volume: return (251ms) {'type': 'block', 'scsi_wwn': '23466663431633039', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466663431633039', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-340052940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-340052940',id=12,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-4wazebw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:35:51Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=1796f4bf-40b0-4a4a-85a5-3690fb761031,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "vif_mac": "fa:16:3e:ae:cf:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "vif_mac": "fa:16:3e:ae:cf:cd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=c95a6584-e3cd-4beb-8917-2bb935d8b507,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc95a6584-e3') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'pci_devices' on Instance uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.objects.base [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<1796f4bf-40b0-4a4a-85a5-3690fb761031> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:37:29 user nova-compute[75239]:   <uuid>1796f4bf-40b0-4a4a-85a5-3690fb761031</uuid>
Nov 13 20:37:29 user nova-compute[75239]:   <name>instance-0000000c</name>
Nov 13 20:37:29 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:37:29 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:37:29 user nova-compute[75239]:   <metadata>
Nov 13 20:37:29 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:37:29 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:37:29 user nova-compute[75239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-340052940</nova:name>
Nov 13 20:37:29 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:37:29</nova:creationTime>
Nov 13 20:37:29 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:37:29 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:37:29 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:37:29 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:37:29 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:37:29 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:37:29 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:37:29 user nova-compute[75239]:       <nova:owner>
Nov 13 20:37:29 user nova-compute[75239]:         <nova:user uuid="2669d647fe6f4034bc70703546345eb3">tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member</nova:user>
Nov 13 20:37:29 user nova-compute[75239]:         <nova:project uuid="f465510aec2849dfb0917120a772f066">tempest-ServerBootFromVolumeStableRescueTest-2033691872</nova:project>
Nov 13 20:37:29 user nova-compute[75239]:       </nova:owner>
Nov 13 20:37:29 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:37:29 user nova-compute[75239]:       <nova:ports>
Nov 13 20:37:29 user nova-compute[75239]:         <nova:port uuid="c95a6584-e3cd-4beb-8917-2bb935d8b507">
Nov 13 20:37:29 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:37:29 user nova-compute[75239]:         </nova:port>
Nov 13 20:37:29 user nova-compute[75239]:       </nova:ports>
Nov 13 20:37:29 user nova-compute[75239]:     </nova:instance>
Nov 13 20:37:29 user nova-compute[75239]:   </metadata>
Nov 13 20:37:29 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:37:29 user nova-compute[75239]:     <system>
Nov 13 20:37:29 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:37:29 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:37:29 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:37:29 user nova-compute[75239]:       <entry name="serial">1796f4bf-40b0-4a4a-85a5-3690fb761031</entry>
Nov 13 20:37:29 user nova-compute[75239]:       <entry name="uuid">1796f4bf-40b0-4a4a-85a5-3690fb761031</entry>
Nov 13 20:37:29 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:37:29 user nova-compute[75239]:     </system>
Nov 13 20:37:29 user nova-compute[75239]:   </sysinfo>
Nov 13 20:37:29 user nova-compute[75239]:   <os>
Nov 13 20:37:29 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:37:29 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:37:29 user nova-compute[75239]:   </os>
Nov 13 20:37:29 user nova-compute[75239]:   <features>
Nov 13 20:37:29 user nova-compute[75239]:     <acpi/>
Nov 13 20:37:29 user nova-compute[75239]:     <apic/>
Nov 13 20:37:29 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:37:29 user nova-compute[75239]:   </features>
Nov 13 20:37:29 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:37:29 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:37:29 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:37:29 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:37:29 user nova-compute[75239]:   </clock>
Nov 13 20:37:29 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:37:29 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:37:29 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:37:29 user nova-compute[75239]:   </cpu>
Nov 13 20:37:29 user nova-compute[75239]:   <devices>
Nov 13 20:37:29 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:37:29 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:37:29 user nova-compute[75239]:       <source dev="/dev/sdb"/>
Nov 13 20:37:29 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:37:29 user nova-compute[75239]:       <serial>1e524d23-a0bd-40df-bd81-6e30dcb200ad</serial>
Nov 13 20:37:29 user nova-compute[75239]:     </disk>
Nov 13 20:37:29 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:37:29 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:37:29 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.rescue"/>
Nov 13 20:37:29 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:37:29 user nova-compute[75239]:       <boot order="1"/>
Nov 13 20:37:29 user nova-compute[75239]:     </disk>
Nov 13 20:37:29 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:37:29 user nova-compute[75239]:       <mac address="fa:16:3e:ae:cf:cd"/>
Nov 13 20:37:29 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:37:29 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:37:29 user nova-compute[75239]:       <target dev="tapc95a6584-e3"/>
Nov 13 20:37:29 user nova-compute[75239]:     </interface>
Nov 13 20:37:29 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:37:29 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/console.log" append="off"/>
Nov 13 20:37:29 user nova-compute[75239]:     </serial>
Nov 13 20:37:29 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:37:29 user nova-compute[75239]:     <video>
Nov 13 20:37:29 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:37:29 user nova-compute[75239]:     </video>
Nov 13 20:37:29 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:37:29 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:37:29 user nova-compute[75239]:     </rng>
Nov 13 20:37:29 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:37:29 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:37:29 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:37:29 user nova-compute[75239]:     </memballoon>
Nov 13 20:37:29 user nova-compute[75239]:   </devices>
Nov 13 20:37:29 user nova-compute[75239]: </domain>
Nov 13 20:37:29 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:37:29 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance destroyed successfully.
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No VIF found with MAC fa:16:3e:ae:cf:cd, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:29 user nova-compute[75239]: INFO nova.compute.manager [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Shelving
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance destroyed successfully.
Nov 13 20:37:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Beginning cold snapshot process
Nov 13 20:37:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:37:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk /opt/stack/data/nova/instances/snapshots/tmpavllu_ht/10ba86761d814b978c91bde6266778bb {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk /opt/stack/data/nova/instances/snapshots/tmpavllu_ht/10ba86761d814b978c91bde6266778bb" returned: 0 in 1.225s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:33 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Snapshot extracted, beginning image upload
Nov 13 20:37:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:37:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9877a0fa-55e8-4652-958a-d9fd804249e4 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:37:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:34 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:37:34 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:37:34 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7045MB free_disk=25.032535552978516GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:37:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d67fcb6b-fb37-4d04-8dab-d74370f76981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ae8531d9-3930-4373-91b2-628d850e8ba7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c3f6a68e-f57c-463f-81fd-e4e047421d5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a193f654-074c-454c-91b2-bb7ced39fb59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 55f96b7f-454c-440a-9c78-f91305569e87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1fe94db5-cf69-4e80-a779-e2182588ab56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-5c2d7dbb-4a63-4931-82f8-9f484bebb165 req-c6a32a90-82ef-42f3-adf5-a4e73822a76c service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-unplugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5c2d7dbb-4a63-4931-82f8-9f484bebb165 req-c6a32a90-82ef-42f3-adf5-a4e73822a76c service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5c2d7dbb-4a63-4931-82f8-9f484bebb165 req-c6a32a90-82ef-42f3-adf5-a4e73822a76c service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5c2d7dbb-4a63-4931-82f8-9f484bebb165 req-c6a32a90-82ef-42f3-adf5-a4e73822a76c service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-5c2d7dbb-4a63-4931-82f8-9f484bebb165 req-c6a32a90-82ef-42f3-adf5-a4e73822a76c service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-unplugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:35 user nova-compute[75239]: WARNING nova.compute.manager [req-5c2d7dbb-4a63-4931-82f8-9f484bebb165 req-c6a32a90-82ef-42f3-adf5-a4e73822a76c service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-unplugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state active and task_state rescuing.
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance fcafe860-22f2-4e7f-b1fc-d515c81762bc has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.853s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.679s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:37:35 user nova-compute[75239]: INFO nova.compute.claims [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Claim successful on node user
Nov 13 20:37:35 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:37:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:37:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:37:36 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:37:36 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:37:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.210s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:37:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:37:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:37:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:37:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Snapshot image upload complete
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating instance_info_cache with network_info: [{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:37 user nova-compute[75239]: WARNING nova.compute.manager [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state rescued and task_state None.
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-unplugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] No waiting events found dispatching network-vif-unplugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:37 user nova-compute[75239]: WARNING nova.compute.manager [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received unexpected event network-vif-unplugged-70460a6e-b85a-4875-94c8-fa1917a78871 for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] No waiting events found dispatching network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:37 user nova-compute[75239]: WARNING nova.compute.manager [req-747b04e9-af1f-49dd-8ba7-5a91132ef05e req-ab2e3aa5-7028-48d1-ad78-8336cbf0d8e7 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received unexpected event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.policy [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '276cb9cf493a47a0a8a4ea045e3277c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffa6e76e666484b8d3d4b66d58c1898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:37:37 user nova-compute[75239]: INFO nova.compute.manager [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Shelve offloading
Nov 13 20:37:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance destroyed successfully.
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquired lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:37:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Creating image(s)
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "a193f654-074c-454c-91b2-bb7ced39fb59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "a193f654-074c-454c-91b2-bb7ced39fb59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "a193f654-074c-454c-91b2-bb7ced39fb59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "a193f654-074c-454c-91b2-bb7ced39fb59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "a193f654-074c-454c-91b2-bb7ced39fb59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:37 user nova-compute[75239]: INFO nova.compute.manager [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Terminating instance
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.210s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk 1073741824" returned: 0 in 0.066s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Cannot resize image /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Ensure instance console log exists: /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:38 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Instance destroyed successfully.
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.objects.instance [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lazy-loading 'resources' on Instance uuid a193f654-074c-454c-91b2-bb7ced39fb59 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-996528989',display_name='tempest-VolumesAdminNegativeTest-server-996528989',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-996528989',id=14,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edd5f6a62ab945aead252eec2f72112b',ramdisk_id='',reservation_id='r-78ge18ji',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1388057922',owner_user_name='tempest-VolumesAdminNegativeTest-1388057922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:35:51Z,user_data=None,user_id='781343c1a6e94234bef9a8d11cea0f9c',uuid=a193f654-074c-454c-91b2-bb7ced39fb59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converting VIF {"id": "2620304b-4a98-49b9-ba78-db9473a7478a", "address": "fa:16:3e:5c:b3:b6", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2620304b-4a", "ovs_interfaceid": "2620304b-4a98-49b9-ba78-db9473a7478a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:b6,bridge_name='br-int',has_traffic_filtering=True,id=2620304b-4a98-49b9-ba78-db9473a7478a,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620304b-4a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG os_vif [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:b6,bridge_name='br-int',has_traffic_filtering=True,id=2620304b-4a98-49b9-ba78-db9473a7478a,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620304b-4a') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2620304b-4a, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc227974-8705-4590-80ba-2d70462a7f4e) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:38 user nova-compute[75239]: INFO os_vif [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:b3:b6,bridge_name='br-int',has_traffic_filtering=True,id=2620304b-4a98-49b9-ba78-db9473a7478a,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2620304b-4a')
Nov 13 20:37:38 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Deleting instance files /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59_del
Nov 13 20:37:38 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Deletion of /opt/stack/data/nova/instances/a193f654-074c-454c-91b2-bb7ced39fb59_del complete
Nov 13 20:37:38 user nova-compute[75239]: INFO nova.compute.manager [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 13 20:37:38 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updating instance_info_cache with network_info: [{"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Releasing lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Successfully created port: a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:37:39 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:39 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Took 1.33 seconds to deallocate network for instance.
Nov 13 20:37:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-421f621a-2e2a-4d50-98e7-79cce281eda0 req-21b2ab27-59c3-4fb5-a9d0-08e731822c46 service nova] [instance: a193f654-074c-454c-91b2-bb7ced39fb59] Received event network-vif-deleted-2620304b-4a98-49b9-ba78-db9473a7478a {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:40 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance destroyed successfully.
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.objects.instance [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'resources' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123715306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123715306',id=13,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJycNLU0bhy2XhsxZOHqqC+x4cDsTf3LnWsRNHL6hFFjdVyVlQXzzyjCQn8YoXQ+dHwMmMoUvJN6eB/MQBaXgQ4735nV4x22OZ4jbmasf6gYcJu0Wwdvr27XrHBBoqb+OQ==',key_name='tempest-keypair-2045310531',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-26o52j6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member',shelved_at='2023-11-13T20:37:37.054947',shelved_host='user',shelved_image_id='55e8040e-9945-405a-bf79-6cd6c26c4353'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:37:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=c3f6a68e-f57c-463f-81fd-e4e047421d5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG os_vif [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70460a6e-b8, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=858e9134-be0d-4cda-b2d6-ff38d5b245f6) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.518s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:37:40 user nova-compute[75239]: INFO os_vif [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8')
Nov 13 20:37:40 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Deleting instance files /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b_del
Nov 13 20:37:40 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Deletion of /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b_del complete
Nov 13 20:37:40 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Deleted allocations for instance a193f654-074c-454c-91b2-bb7ced39fb59
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Successfully updated port: a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:37:40 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Deleted allocations for instance c3f6a68e-f57c-463f-81fd-e4e047421d5b
Nov 13 20:37:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f8309aef-0b6d-4a7c-a4a4-7dd0a9d516f6 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "a193f654-074c-454c-91b2-bb7ced39fb59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.073s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquired lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.objects.instance [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'numa_topology' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.objects.base [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<c3f6a68e-f57c-463f-81fd-e4e047421d5b> lazy-loaded attributes: resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updating instance_info_cache with network_info: [{"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Releasing lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Instance network_info: |[{"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:37:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Start _get_guest_xml network_info=[{"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:37:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:37:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328986222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328986222',id=20,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzePX1hT2woml8vSrOF8vsehzyoQyDIDpKzXNnSV7g611OdghErTyj7yzdlaSTAX9UCgl8tKvGNN0b/Ma50TAXHkeoKbz087TbCFE625mSyZ4RbQrLqedGEnT1H3VPyVA==',key_name='tempest-keypair-989254085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fffa6e76e666484b8d3d4b66d58c1898',ramdisk_id='',reservation_id='r-fektjpro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2035153286',owner_user_name='tempest-TaggedAttachmentsTest-2035153286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276cb9cf493a47a0a8a4ea045e3277c4',uuid=fcafe860-22f2-4e7f-b1fc-d515c81762bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converting VIF {"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:01:3d,bridge_name='br-int',has_traffic_filtering=True,id=a8636abe-8a8c-471f-add4-dbec8745a4a4,network=Network(af8e991b-e71b-495e-8738-aa6a6ca1b086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8636abe-8a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lazy-loading 'pci_devices' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:37:41 user nova-compute[75239]:   <uuid>fcafe860-22f2-4e7f-b1fc-d515c81762bc</uuid>
Nov 13 20:37:41 user nova-compute[75239]:   <name>instance-00000014</name>
Nov 13 20:37:41 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:37:41 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:37:41 user nova-compute[75239]:   <metadata>
Nov 13 20:37:41 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:37:41 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:37:41 user nova-compute[75239]:       <nova:name>tempest-device-tagging-server-1328986222</nova:name>
Nov 13 20:37:41 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:37:41</nova:creationTime>
Nov 13 20:37:41 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:37:41 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:37:41 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:37:41 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:37:41 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:37:41 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:37:41 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:37:41 user nova-compute[75239]:       <nova:owner>
Nov 13 20:37:41 user nova-compute[75239]:         <nova:user uuid="276cb9cf493a47a0a8a4ea045e3277c4">tempest-TaggedAttachmentsTest-2035153286-project-member</nova:user>
Nov 13 20:37:41 user nova-compute[75239]:         <nova:project uuid="fffa6e76e666484b8d3d4b66d58c1898">tempest-TaggedAttachmentsTest-2035153286</nova:project>
Nov 13 20:37:41 user nova-compute[75239]:       </nova:owner>
Nov 13 20:37:41 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:37:41 user nova-compute[75239]:       <nova:ports>
Nov 13 20:37:41 user nova-compute[75239]:         <nova:port uuid="a8636abe-8a8c-471f-add4-dbec8745a4a4">
Nov 13 20:37:41 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:37:41 user nova-compute[75239]:         </nova:port>
Nov 13 20:37:41 user nova-compute[75239]:       </nova:ports>
Nov 13 20:37:41 user nova-compute[75239]:     </nova:instance>
Nov 13 20:37:41 user nova-compute[75239]:   </metadata>
Nov 13 20:37:41 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:37:41 user nova-compute[75239]:     <system>
Nov 13 20:37:41 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:37:41 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:37:41 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:37:41 user nova-compute[75239]:       <entry name="serial">fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:37:41 user nova-compute[75239]:       <entry name="uuid">fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:37:41 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:37:41 user nova-compute[75239]:     </system>
Nov 13 20:37:41 user nova-compute[75239]:   </sysinfo>
Nov 13 20:37:41 user nova-compute[75239]:   <os>
Nov 13 20:37:41 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:37:41 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:37:41 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:37:41 user nova-compute[75239]:   </os>
Nov 13 20:37:41 user nova-compute[75239]:   <features>
Nov 13 20:37:41 user nova-compute[75239]:     <acpi/>
Nov 13 20:37:41 user nova-compute[75239]:     <apic/>
Nov 13 20:37:41 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:37:41 user nova-compute[75239]:   </features>
Nov 13 20:37:41 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:37:41 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:37:41 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:37:41 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:37:41 user nova-compute[75239]:   </clock>
Nov 13 20:37:41 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:37:41 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:37:41 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:37:41 user nova-compute[75239]:   </cpu>
Nov 13 20:37:41 user nova-compute[75239]:   <devices>
Nov 13 20:37:41 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:37:41 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:37:41 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk"/>
Nov 13 20:37:41 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:37:41 user nova-compute[75239]:     </disk>
Nov 13 20:37:41 user nova-compute[75239]:     <disk type="file" device="cdrom">
Nov 13 20:37:41 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 20:37:41 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.config"/>
Nov 13 20:37:41 user nova-compute[75239]:       <target dev="hda" bus="ide"/>
Nov 13 20:37:41 user nova-compute[75239]:     </disk>
Nov 13 20:37:41 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:37:41 user nova-compute[75239]:       <mac address="fa:16:3e:8e:01:3d"/>
Nov 13 20:37:41 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:37:41 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:37:41 user nova-compute[75239]:       <target dev="tapa8636abe-8a"/>
Nov 13 20:37:41 user nova-compute[75239]:     </interface>
Nov 13 20:37:41 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:37:41 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log" append="off"/>
Nov 13 20:37:41 user nova-compute[75239]:     </serial>
Nov 13 20:37:41 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:37:41 user nova-compute[75239]:     <video>
Nov 13 20:37:41 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:37:41 user nova-compute[75239]:     </video>
Nov 13 20:37:41 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:37:41 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:37:41 user nova-compute[75239]:     </rng>
Nov 13 20:37:41 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:37:41 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:37:41 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:37:41 user nova-compute[75239]:     </memballoon>
Nov 13 20:37:41 user nova-compute[75239]:   </devices>
Nov 13 20:37:41 user nova-compute[75239]: </domain>
Nov 13 20:37:41 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328986222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328986222',id=20,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzePX1hT2woml8vSrOF8vsehzyoQyDIDpKzXNnSV7g611OdghErTyj7yzdlaSTAX9UCgl8tKvGNN0b/Ma50TAXHkeoKbz087TbCFE625mSyZ4RbQrLqedGEnT1H3VPyVA==',key_name='tempest-keypair-989254085',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fffa6e76e666484b8d3d4b66d58c1898',ramdisk_id='',reservation_id='r-fektjpro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2035153286',owner_user_name='tempest-TaggedAttachmentsTest-2035153286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276cb9cf493a47a0a8a4ea045e3277c4',uuid=fcafe860-22f2-4e7f-b1fc-d515c81762bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converting VIF {"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:01:3d,bridge_name='br-int',has_traffic_filtering=True,id=a8636abe-8a8c-471f-add4-dbec8745a4a4,network=Network(af8e991b-e71b-495e-8738-aa6a6ca1b086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8636abe-8a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG os_vif [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:01:3d,bridge_name='br-int',has_traffic_filtering=True,id=a8636abe-8a8c-471f-add4-dbec8745a4a4,network=Network(af8e991b-e71b-495e-8738-aa6a6ca1b086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8636abe-8a') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cb540ec-a70a-5247-8035-bb75268f71c1', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8636abe-8a, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8636abe-8a, col_values=(('qos', UUID('b3d79de9-adab-4169-8c34-86b4750112c1')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8636abe-8a, col_values=(('external_ids', {'iface-id': 'a8636abe-8a8c-471f-add4-dbec8745a4a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:01:3d', 'vm-uuid': 'fcafe860-22f2-4e7f-b1fc-d515c81762bc'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:41 user nova-compute[75239]: INFO os_vif [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:01:3d,bridge_name='br-int',has_traffic_filtering=True,id=a8636abe-8a8c-471f-add4-dbec8745a4a4,network=Network(af8e991b-e71b-495e-8738-aa6a6ca1b086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8636abe-8a')
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] No BDM found with device name hda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] No VIF found with MAC fa:16:3e:8e:01:3d, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:37:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Using config drive
Nov 13 20:37:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ef656a21-c225-42a8-a1ad-e6223fdbd7c5 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 11.284s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Creating config drive at /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.config
Nov 13 20:37:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgug0kge0 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgug0kge0" returned: 0 in 0.073s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-ce1f0307-03a9-4c54-90e7-b190c1cc4332 req-c00ae103-fc51-4510-8f30-6320d954f632 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-changed-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-ce1f0307-03a9-4c54-90e7-b190c1cc4332 req-c00ae103-fc51-4510-8f30-6320d954f632 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Refreshing instance network info cache due to event network-changed-a8636abe-8a8c-471f-add4-dbec8745a4a4. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ce1f0307-03a9-4c54-90e7-b190c1cc4332 req-c00ae103-fc51-4510-8f30-6320d954f632 service nova] Acquiring lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ce1f0307-03a9-4c54-90e7-b190c1cc4332 req-c00ae103-fc51-4510-8f30-6320d954f632 service nova] Acquired lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:41 user nova-compute[75239]: DEBUG nova.network.neutron [req-ce1f0307-03a9-4c54-90e7-b190c1cc4332 req-c00ae103-fc51-4510-8f30-6320d954f632 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Refreshing network info cache for port a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-ce1f0307-03a9-4c54-90e7-b190c1cc4332 req-c00ae103-fc51-4510-8f30-6320d954f632 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updated VIF entry in instance network info cache for port a8636abe-8a8c-471f-add4-dbec8745a4a4. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:37:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-ce1f0307-03a9-4c54-90e7-b190c1cc4332 req-c00ae103-fc51-4510-8f30-6320d954f632 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updating instance_info_cache with network_info: [{"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ce1f0307-03a9-4c54-90e7-b190c1cc4332 req-c00ae103-fc51-4510-8f30-6320d954f632 service nova] Releasing lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-19422dbf-a920-49f2-80a0-8b6fae29ee62 req-b7d4c2c7-12ce-4446-aec9-0911672d681b service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-19422dbf-a920-49f2-80a0-8b6fae29ee62 req-b7d4c2c7-12ce-4446-aec9-0911672d681b service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-19422dbf-a920-49f2-80a0-8b6fae29ee62 req-b7d4c2c7-12ce-4446-aec9-0911672d681b service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-19422dbf-a920-49f2-80a0-8b6fae29ee62 req-b7d4c2c7-12ce-4446-aec9-0911672d681b service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-19422dbf-a920-49f2-80a0-8b6fae29ee62 req-b7d4c2c7-12ce-4446-aec9-0911672d681b service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:43 user nova-compute[75239]: WARNING nova.compute.manager [req-19422dbf-a920-49f2-80a0-8b6fae29ee62 req-b7d4c2c7-12ce-4446-aec9-0911672d681b service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 for instance with vm_state building and task_state spawning.
Nov 13 20:37:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:44 user nova-compute[75239]: WARNING nova.compute.manager [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state rescued and task_state None.
Nov 13 20:37:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:44 user nova-compute[75239]: WARNING nova.compute.manager [req-60864bbb-e394-4597-9b31-894054a1d833 req-159c17ae-18df-4503-8fcf-cbb4ab9448d4 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state rescued and task_state None.
Nov 13 20:37:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:37:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:37:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Instance spawned successfully.
Nov 13 20:37:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:37:45 user nova-compute[75239]: INFO nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Took 7.89 seconds to spawn the instance on the hypervisor.
Nov 13 20:37:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-73cb07c8-eb3f-410b-87fc-7fc4c3f0d61e req-0ac69af2-5324-46c5-b37a-dd3de08bc448 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-73cb07c8-eb3f-410b-87fc-7fc4c3f0d61e req-0ac69af2-5324-46c5-b37a-dd3de08bc448 service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-73cb07c8-eb3f-410b-87fc-7fc4c3f0d61e req-0ac69af2-5324-46c5-b37a-dd3de08bc448 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-73cb07c8-eb3f-410b-87fc-7fc4c3f0d61e req-0ac69af2-5324-46c5-b37a-dd3de08bc448 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-73cb07c8-eb3f-410b-87fc-7fc4c3f0d61e req-0ac69af2-5324-46c5-b37a-dd3de08bc448 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:37:45 user nova-compute[75239]: WARNING nova.compute.manager [req-73cb07c8-eb3f-410b-87fc-7fc4c3f0d61e req-0ac69af2-5324-46c5-b37a-dd3de08bc448 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 for instance with vm_state building and task_state spawning.
Nov 13 20:37:45 user nova-compute[75239]: INFO nova.compute.manager [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Took 10.26 seconds to build instance.
Nov 13 20:37:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8712fcde-ba50-486b-a939-1e71bcb46237 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.383s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "f867644d-af12-4b8b-be06-ff6c00344095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:37:47 user nova-compute[75239]: INFO nova.compute.claims [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Claim successful on node user
Nov 13 20:37:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:37:47 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:37:47 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:37:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:37:47 user nova-compute[75239]: INFO nova.virt.block_device [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Booting with volume e7342345-3b13-452f-bb61-dc3d012ceb2c at /dev/vda
Nov 13 20:37:48 user nova-compute[75239]: DEBUG os_brick.utils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG nova.policy [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a8e4901f8094f61a7189ee21d85f65a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee07325ee534b3a92cb18de0fc6a748', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[77052d4c-5201-4f8c-b9b3-d63755fe9d56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[afae4c8f-4b39-4aa5-99ed-6497e97ee2eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6913729e-3c5f-4b79-9b8c-57a9ffb2aae6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1121f393-54ac-4196-90fe-dca788a09ddf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:37:48 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:37:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[781b10a3-907e-44de-99e4-b86d6b6a2b47]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG os_brick.utils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating existing volume attachment record: 0078a24e-84d1-41a7-91d0-7ee0b318138a {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:37:48 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully created port: 77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:37:49 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully created port: 200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:37:50 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully created port: 92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:37:50 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully created port: 42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:37:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:51 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully created port: f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully updated port: 77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-b4a82f20-6c15-4524-afe0-63fede10608a req-4ac090c0-1252-4629-b34b-3c5138ce60be service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-changed-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-b4a82f20-6c15-4524-afe0-63fede10608a req-4ac090c0-1252-4629-b34b-3c5138ce60be service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing instance network info cache due to event network-changed-77d1bec8-0075-42a5-ae4c-85e20523b131. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b4a82f20-6c15-4524-afe0-63fede10608a req-4ac090c0-1252-4629-b34b-3c5138ce60be service nova] Acquiring lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b4a82f20-6c15-4524-afe0-63fede10608a req-4ac090c0-1252-4629-b34b-3c5138ce60be service nova] Acquired lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG nova.network.neutron [req-b4a82f20-6c15-4524-afe0-63fede10608a req-4ac090c0-1252-4629-b34b-3c5138ce60be service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing network info cache for port 77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG nova.network.neutron [req-b4a82f20-6c15-4524-afe0-63fede10608a req-4ac090c0-1252-4629-b34b-3c5138ce60be service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG nova.network.neutron [req-b4a82f20-6c15-4524-afe0-63fede10608a req-4ac090c0-1252-4629-b34b-3c5138ce60be service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b4a82f20-6c15-4524-afe0-63fede10608a req-4ac090c0-1252-4629-b34b-3c5138ce60be service nova] Releasing lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:52 user nova-compute[75239]: INFO nova.virt.block_device [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Booting with volume 6258033b-be24-418d-b1dc-f751db320030 at /dev/vdb
Nov 13 20:37:52 user nova-compute[75239]: DEBUG os_brick.utils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[50daf582-cdcb-4afd-a75f-b66aec1ac7e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd682815-3dbe-446a-ab64-89e7910f91cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully updated port: f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdcf1a7-989e-4e05-9a82-f7ed525d0663]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad08f90-7bd6-4798-8427-a939cc196b4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:37:52 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:37:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceb21a1-2d48-4b84-a464-9bd929535ec1]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG os_brick.utils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:37:52 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating existing volume attachment record: f1f8a617-18b7-4e9e-8732-67d1748e7272 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:37:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully updated port: b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully updated port: 200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-changed-f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing instance network info cache due to event network-changed-f2b9f7ee-3832-401a-b4c0-4620bfed1148. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] Acquiring lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] Acquired lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing network info cache for port f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] Releasing lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-changed-b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing instance network info cache due to event network-changed-b79d0880-dc18-45b3-ad95-09fd3ff58395. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] Acquiring lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] Acquired lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing network info cache for port b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69baeb6f-a609-4c75-89d6-8ee82fa01db1 req-6c4ab0e4-617d-4d58-a6e4-7ae2d31f73cd service nova] Releasing lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully updated port: 92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:37:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully updated port: 42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-changed-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing instance network info cache due to event network-changed-200b2855-5a4a-4ef4-b4d2-a3328f7d8637. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] Acquiring lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] Acquired lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG nova.network.neutron [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing network info cache for port 200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG nova.network.neutron [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG nova.network.neutron [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] Releasing lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-changed-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing instance network info cache due to event network-changed-92b00a74-9a51-477d-8010-e2f86e1cabbf. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] Acquiring lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] Acquired lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG nova.network.neutron [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing network info cache for port 92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:56 user nova-compute[75239]: DEBUG nova.network.neutron [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Successfully updated port: f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] Releasing lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-changed-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing instance network info cache due to event network-changed-42a122d2-f18d-46a5-9b9b-fb60602bfe82. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] Acquiring lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] Acquired lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing network info cache for port 42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:37:57 user nova-compute[75239]: INFO nova.virt.block_device [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Booting with volume cdceccf9-b81f-4c8e-86a5-494b5b51ae7b at /dev/vdc
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-44cc5329-f2dd-4131-87f2-d83dc6a223e5 req-231ad9d4-31a8-4261-828a-1b155418a1d7 service nova] Releasing lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquired lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG os_brick.utils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f05d244-dd59-41f4-95cc-fc3a08c16409]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebd730e-7b23-45a6-b83a-48ac3b4ea86c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ab68cf-2f3c-4859-92d5-c1a050e9eaba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7a921c-4ada-42d6-8970-4a3762903af7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:37:57 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:37:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e55408-60a1-4504-9c55-ea26fea24bee]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG os_brick.utils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:37:57 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating existing volume attachment record: b98c220f-968b-452e-b82a-d1c738f13633 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:37:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-553f2541-790b-446f-8abd-982bc926649d req-067929ba-2839-4dfa-bc53-ffca7463ce3b service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-changed-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:37:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-553f2541-790b-446f-8abd-982bc926649d req-067929ba-2839-4dfa-bc53-ffca7463ce3b service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing instance network info cache due to event network-changed-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:37:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-553f2541-790b-446f-8abd-982bc926649d req-067929ba-2839-4dfa-bc53-ffca7463ce3b service nova] Acquiring lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:37:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [{"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Releasing lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:37:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance network_info: |[{"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:37:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-553f2541-790b-446f-8abd-982bc926649d req-067929ba-2839-4dfa-bc53-ffca7463ce3b service nova] Acquired lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:37:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-553f2541-790b-446f-8abd-982bc926649d req-067929ba-2839-4dfa-bc53-ffca7463ce3b service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing network info cache for port f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:37:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-553f2541-790b-446f-8abd-982bc926649d req-067929ba-2839-4dfa-bc53-ffca7463ce3b service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updated VIF entry in instance network info cache for port f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:37:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-553f2541-790b-446f-8abd-982bc926649d req-067929ba-2839-4dfa-bc53-ffca7463ce3b service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [{"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:37:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-553f2541-790b-446f-8abd-982bc926649d req-067929ba-2839-4dfa-bc53-ffca7463ce3b service nova] Releasing lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:38:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Creating image(s)
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Ensure instance console log exists: /opt/stack/data/nova/instances/f867644d-af12-4b8b-be06-ff6c00344095/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Start _get_guest_xml network_info=[{"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0078a24e-84d1-41a7-91d0-7ee0b318138a', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMfDZdsC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f867644d-af12-4b8b-be06-ff6c00344095', 'attached_at': '', 'detached_at': '', 'volume_id': 'e7342345-3b13-452f-bb61-dc3d012ceb2c', 'serial': 'e7342345-3b13-452f-bb61-dc3d012ceb2c'}, 'guest_format': None, 'volume_type': None}, {'attachment_id': 'f1f8a617-18b7-4e9e-8732-67d1748e7272', 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JznDxBEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f867644d-af12-4b8b-be06-ff6c00344095', 'attached_at': '', 'detached_at': '', 'volume_id': '6258033b-be24-418d-b1dc-f751db320030', 'serial': '6258033b-be24-418d-b1dc-f751db320030'}, 'guest_format': None, 'volume_type': None}, {'attachment_id': 'b98c220f-968b-452e-b82a-d1c738f13633', 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJNnhXvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f867644d-af12-4b8b-be06-ff6c00344095', 'attached_at': '', 'detached_at': '', 'volume_id': 'cdceccf9-b81f-4c8e-86a5-494b5b51ae7b', 'serial': 'cdceccf9-b81f-4c8e-86a5-494b5b51ae7b'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:38:01 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:38:01 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:38:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMfDZdsC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:02 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:02 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:02 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[13766f9c-a5e0-443c-bc4e-121832f5d891]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:38:02 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd515ac-7add-4d89-9766-4ad6796f041d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c] added
Nov 13 20:38:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8da8ca6-9893-44be-afcb-2d23662c83f2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed74c72-527f-4e81-812d-2b973289e4bb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NMfDZdsC {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NMfDZdsC" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5b7e03-7877-4baa-aff9-8d6ae3ca8920]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NMfDZdsC'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03126b06-f59f-41bc-acb5-abb080cddcae]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6911a3a-7882-477c-85c2-37599ec8f48e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebe0536-b647-4c7b-b37a-3526b4df331f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c, portal: 172.16.0.220,3260]
Nov 13 20:38:02 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c, portal: 172.16.0.220,3260] successful.
Nov 13 20:38:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[698fc93c-1ed6-49ee-8ce3-929cd0073c58]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[947cc46f-aa7e-41af-a051-94522f587d70]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:02 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fc7abd-3b1f-47e8-8c99-5c710f20b60d]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMfDZdsC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:38:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23462333264333066', 'path': '/dev/sdf'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462333264333066', 'path': '/dev/sdf'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JznDxBEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:03 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:03 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:03 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b1157a-58ab-401c-bce9-da6a06717f94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:38:03 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5150cc-0124-401d-8f47-e1f840dee567]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030] added
Nov 13 20:38:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e63de0-78cc-4bc5-881f-bc168ef59730]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.117s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9164fe9-c7e6-4574-aded-336b0ac127a0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JznDxBEf {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JznDxBEf" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d5a0af-832b-4c00-b55a-891ec8c5d0b6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JznDxBEf'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7846bea-f72e-4b5f-95a8-de0b3a444520]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa81eff-9fc3-4e99-8627-679c445d855a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbec4c29-6ea2-4307-9d0f-87fac8ecc2b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030, portal: 172.16.0.220,3260]
Nov 13 20:38:03 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030, portal: 172.16.0.220,3260] successful.
Nov 13 20:38:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2708a98-1fe8-448f-b9d7-e09d7c8272b6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fec8062-6835-453f-ab58-1105ce0d40d9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:03 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.412s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b6f8ec-22f8-4b21-8f56-0387787e624f]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:38:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JznDxBEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] <== connect_volume: return (1453ms) {'type': 'block', 'scsi_wwn': '23830613237333334', 'path': '/dev/sdg'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830613237333334', 'path': '/dev/sdg'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJNnhXvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:04 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:04 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:04 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa6d4d1-d593-4470-ab60-c0cb3e779540]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:38:04 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a523d7a-f712-4631-a1a4-30239ee29354]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b] added
Nov 13 20:38:04 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af37ee9-039c-49af-8642-9001a5934faf]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ef2148-4b5d-420c-909f-0fed491d83a4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJNnhXvr {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eJNnhXvr" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f60fb66-c673-4ace-870a-fc0f6e5cf2af]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eJNnhXvr'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[335dc8d8-c99d-4a8a-bbc6-cb510b09ba12]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[27840816-458c-401c-8981-36716bc299ca]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba587b05-71eb-4540-803a-1847760d4204]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b, portal: 172.16.0.220,3260]
Nov 13 20:38:05 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b, portal: 172.16.0.220,3260] successful.
Nov 13 20:38:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[07358834-584d-4735-a3d6-77510031b97f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a60b84-6dae-48e0-a3fd-eeeed2d56bf9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:05 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77630a8-583c-4c44-b7dc-45721ba52c41]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:38:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJNnhXvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26530393437393166', 'path': '/dev/sdh'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530393437393166', 'path': '/dev/sdh'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:08,bridge_name='br-int',has_traffic_filtering=True,id=77d1bec8-0075-42a5-ae4c-85e20523b131,network=Network(7b8e659e-516e-4298-9894-605199d2bba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d1bec8-00') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:af:00,bridge_name='br-int',has_traffic_filtering=True,id=f2b9f7ee-3832-401a-b4c0-4620bfed1148,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2b9f7ee-38') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7d:1d,bridge_name='br-int',has_traffic_filtering=True,id=b79d0880-dc18-45b3-ad95-09fd3ff58395,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb79d0880-dc') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=200b2855-5a4a-4ef4-b4d2-a3328f7d8637,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap200b2855-5a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:71:89,bridge_name='br-int',has_traffic_filtering=True,id=92b00a74-9a51-477d-8010-e2f86e1cabbf,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b00a74-9a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:9f:95,bridge_name='br-int',has_traffic_filtering=True,id=42a122d2-f18d-46a5-9b9b-fb60602bfe82,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a122d2-f1') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:29:52,bridge_name='br-int',has_traffic_filtering=True,id=f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ccc5fa-9e') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.objects.instance [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lazy-loading 'pci_devices' on Instance uuid f867644d-af12-4b8b-be06-ff6c00344095 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:38:06 user nova-compute[75239]:   <uuid>f867644d-af12-4b8b-be06-ff6c00344095</uuid>
Nov 13 20:38:06 user nova-compute[75239]:   <name>instance-00000015</name>
Nov 13 20:38:06 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:38:06 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:38:06 user nova-compute[75239]:   <metadata>
Nov 13 20:38:06 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:38:06 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:38:06 user nova-compute[75239]:       <nova:name>tempest-device-tagging-server-1941988757</nova:name>
Nov 13 20:38:06 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:38:01</nova:creationTime>
Nov 13 20:38:06 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:38:06 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:38:06 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:38:06 user nova-compute[75239]:       <nova:owner>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:user uuid="9a8e4901f8094f61a7189ee21d85f65a">tempest-TaggedBootDevicesTest_v242-1283413932-project-member</nova:user>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:project uuid="cee07325ee534b3a92cb18de0fc6a748">tempest-TaggedBootDevicesTest_v242-1283413932</nova:project>
Nov 13 20:38:06 user nova-compute[75239]:       </nova:owner>
Nov 13 20:38:06 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:38:06 user nova-compute[75239]:       <nova:ports>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:port uuid="77d1bec8-0075-42a5-ae4c-85e20523b131">
Nov 13 20:38:06 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:38:06 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:port uuid="f2b9f7ee-3832-401a-b4c0-4620bfed1148">
Nov 13 20:38:06 user nova-compute[75239]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Nov 13 20:38:06 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:port uuid="b79d0880-dc18-45b3-ad95-09fd3ff58395">
Nov 13 20:38:06 user nova-compute[75239]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Nov 13 20:38:06 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:port uuid="200b2855-5a4a-4ef4-b4d2-a3328f7d8637">
Nov 13 20:38:06 user nova-compute[75239]:           <nova:ip type="fixed" address="10.1.1.236" ipVersion="4"/>
Nov 13 20:38:06 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:port uuid="92b00a74-9a51-477d-8010-e2f86e1cabbf">
Nov 13 20:38:06 user nova-compute[75239]:           <nova:ip type="fixed" address="10.1.1.7" ipVersion="4"/>
Nov 13 20:38:06 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:port uuid="42a122d2-f18d-46a5-9b9b-fb60602bfe82">
Nov 13 20:38:06 user nova-compute[75239]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 20:38:06 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:06 user nova-compute[75239]:         <nova:port uuid="f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7">
Nov 13 20:38:06 user nova-compute[75239]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 20:38:06 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:06 user nova-compute[75239]:       </nova:ports>
Nov 13 20:38:06 user nova-compute[75239]:     </nova:instance>
Nov 13 20:38:06 user nova-compute[75239]:   </metadata>
Nov 13 20:38:06 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:38:06 user nova-compute[75239]:     <system>
Nov 13 20:38:06 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:38:06 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:38:06 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:38:06 user nova-compute[75239]:       <entry name="serial">f867644d-af12-4b8b-be06-ff6c00344095</entry>
Nov 13 20:38:06 user nova-compute[75239]:       <entry name="uuid">f867644d-af12-4b8b-be06-ff6c00344095</entry>
Nov 13 20:38:06 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:38:06 user nova-compute[75239]:     </system>
Nov 13 20:38:06 user nova-compute[75239]:   </sysinfo>
Nov 13 20:38:06 user nova-compute[75239]:   <os>
Nov 13 20:38:06 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:38:06 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:38:06 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:38:06 user nova-compute[75239]:   </os>
Nov 13 20:38:06 user nova-compute[75239]:   <features>
Nov 13 20:38:06 user nova-compute[75239]:     <acpi/>
Nov 13 20:38:06 user nova-compute[75239]:     <apic/>
Nov 13 20:38:06 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:38:06 user nova-compute[75239]:   </features>
Nov 13 20:38:06 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:38:06 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:38:06 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:38:06 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:38:06 user nova-compute[75239]:   </clock>
Nov 13 20:38:06 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:38:06 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:38:06 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:38:06 user nova-compute[75239]:   </cpu>
Nov 13 20:38:06 user nova-compute[75239]:   <devices>
Nov 13 20:38:06 user nova-compute[75239]:     <disk type="file" device="cdrom">
Nov 13 20:38:06 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 20:38:06 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/f867644d-af12-4b8b-be06-ff6c00344095/disk.config"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="hda" bus="ide"/>
Nov 13 20:38:06 user nova-compute[75239]:     </disk>
Nov 13 20:38:06 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:38:06 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:06 user nova-compute[75239]:       <source dev="/dev/sdf"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <serial>e7342345-3b13-452f-bb61-dc3d012ceb2c</serial>
Nov 13 20:38:06 user nova-compute[75239]:     </disk>
Nov 13 20:38:06 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:38:06 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:06 user nova-compute[75239]:       <source dev="/dev/sdg"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <serial>6258033b-be24-418d-b1dc-f751db320030</serial>
Nov 13 20:38:06 user nova-compute[75239]:     </disk>
Nov 13 20:38:06 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:38:06 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:06 user nova-compute[75239]:       <source dev="/dev/sdh"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="vdc" bus="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <serial>cdceccf9-b81f-4c8e-86a5-494b5b51ae7b</serial>
Nov 13 20:38:06 user nova-compute[75239]:     </disk>
Nov 13 20:38:06 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:06 user nova-compute[75239]:       <mac address="fa:16:3e:02:55:08"/>
Nov 13 20:38:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="tap77d1bec8-00"/>
Nov 13 20:38:06 user nova-compute[75239]:     </interface>
Nov 13 20:38:06 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:06 user nova-compute[75239]:       <mac address="fa:16:3e:f9:af:00"/>
Nov 13 20:38:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="tapf2b9f7ee-38"/>
Nov 13 20:38:06 user nova-compute[75239]:     </interface>
Nov 13 20:38:06 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:06 user nova-compute[75239]:       <mac address="fa:16:3e:8b:7d:1d"/>
Nov 13 20:38:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="tapb79d0880-dc"/>
Nov 13 20:38:06 user nova-compute[75239]:     </interface>
Nov 13 20:38:06 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:06 user nova-compute[75239]:       <mac address="fa:16:3e:62:7f:5f"/>
Nov 13 20:38:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="tap200b2855-5a"/>
Nov 13 20:38:06 user nova-compute[75239]:     </interface>
Nov 13 20:38:06 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:06 user nova-compute[75239]:       <mac address="fa:16:3e:61:71:89"/>
Nov 13 20:38:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="tap92b00a74-9a"/>
Nov 13 20:38:06 user nova-compute[75239]:     </interface>
Nov 13 20:38:06 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:06 user nova-compute[75239]:       <mac address="fa:16:3e:56:9f:95"/>
Nov 13 20:38:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="tap42a122d2-f1"/>
Nov 13 20:38:06 user nova-compute[75239]:     </interface>
Nov 13 20:38:06 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:06 user nova-compute[75239]:       <mac address="fa:16:3e:89:29:52"/>
Nov 13 20:38:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:06 user nova-compute[75239]:       <target dev="tapf7ccc5fa-9e"/>
Nov 13 20:38:06 user nova-compute[75239]:     </interface>
Nov 13 20:38:06 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:38:06 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/f867644d-af12-4b8b-be06-ff6c00344095/console.log" append="off"/>
Nov 13 20:38:06 user nova-compute[75239]:     </serial>
Nov 13 20:38:06 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:38:06 user nova-compute[75239]:     <video>
Nov 13 20:38:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:06 user nova-compute[75239]:     </video>
Nov 13 20:38:06 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:38:06 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:38:06 user nova-compute[75239]:     </rng>
Nov 13 20:38:06 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:38:06 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:38:06 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:38:06 user nova-compute[75239]:     </memballoon>
Nov 13 20:38:06 user nova-compute[75239]:   </devices>
Nov 13 20:38:06 user nova-compute[75239]: </domain>
Nov 13 20:38:06 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:08,bridge_name='br-int',has_traffic_filtering=True,id=77d1bec8-0075-42a5-ae4c-85e20523b131,network=Network(7b8e659e-516e-4298-9894-605199d2bba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d1bec8-00') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:08,bridge_name='br-int',has_traffic_filtering=True,id=77d1bec8-0075-42a5-ae4c-85e20523b131,network=Network(7b8e659e-516e-4298-9894-605199d2bba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d1bec8-00') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ae004fe-10a7-56a9-8cc9-36df3beb7cd8', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77d1bec8-00, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77d1bec8-00, col_values=(('qos', UUID('e139cec7-5ded-4913-b1d6-da8f3c761190')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77d1bec8-00, col_values=(('external_ids', {'iface-id': '77d1bec8-0075-42a5-ae4c-85e20523b131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:55:08', 'vm-uuid': 'f867644d-af12-4b8b-be06-ff6c00344095'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: INFO os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:55:08,bridge_name='br-int',has_traffic_filtering=True,id=77d1bec8-0075-42a5-ae4c-85e20523b131,network=Network(7b8e659e-516e-4298-9894-605199d2bba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d1bec8-00')
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:af:00,bridge_name='br-int',has_traffic_filtering=True,id=f2b9f7ee-3832-401a-b4c0-4620bfed1148,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2b9f7ee-38') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:af:00,bridge_name='br-int',has_traffic_filtering=True,id=f2b9f7ee-3832-401a-b4c0-4620bfed1148,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2b9f7ee-38') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '277c7f20-7ad1-58c1-b598-b4985c8b2155', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2b9f7ee-38, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2b9f7ee-38, col_values=(('qos', UUID('adc8d476-d570-45ae-9ff7-c838638bc3a8')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2b9f7ee-38, col_values=(('external_ids', {'iface-id': 'f2b9f7ee-3832-401a-b4c0-4620bfed1148', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:af:00', 'vm-uuid': 'f867644d-af12-4b8b-be06-ff6c00344095'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: INFO os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:af:00,bridge_name='br-int',has_traffic_filtering=True,id=f2b9f7ee-3832-401a-b4c0-4620bfed1148,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2b9f7ee-38')
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7d:1d,bridge_name='br-int',has_traffic_filtering=True,id=b79d0880-dc18-45b3-ad95-09fd3ff58395,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb79d0880-dc') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7d:1d,bridge_name='br-int',has_traffic_filtering=True,id=b79d0880-dc18-45b3-ad95-09fd3ff58395,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb79d0880-dc') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8763ac8-011c-5ef3-b963-538c36f4cc16', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb79d0880-dc, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb79d0880-dc, col_values=(('qos', UUID('9db23457-9e4b-4a20-8620-a567c8a8ef4a')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb79d0880-dc, col_values=(('external_ids', {'iface-id': 'b79d0880-dc18-45b3-ad95-09fd3ff58395', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:7d:1d', 'vm-uuid': 'f867644d-af12-4b8b-be06-ff6c00344095'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: INFO os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7d:1d,bridge_name='br-int',has_traffic_filtering=True,id=b79d0880-dc18-45b3-ad95-09fd3ff58395,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb79d0880-dc')
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=200b2855-5a4a-4ef4-b4d2-a3328f7d8637,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap200b2855-5a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=200b2855-5a4a-4ef4-b4d2-a3328f7d8637,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap200b2855-5a') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddf525b8-c8f8-5d6c-919a-ab44d96cf212', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap200b2855-5a, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap200b2855-5a, col_values=(('qos', UUID('b542ece1-e128-4124-bc0c-f1bacecc0cda')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap200b2855-5a, col_values=(('external_ids', {'iface-id': '200b2855-5a4a-4ef4-b4d2-a3328f7d8637', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:7f:5f', 'vm-uuid': 'f867644d-af12-4b8b-be06-ff6c00344095'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: INFO os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=200b2855-5a4a-4ef4-b4d2-a3328f7d8637,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap200b2855-5a')
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:71:89,bridge_name='br-int',has_traffic_filtering=True,id=92b00a74-9a51-477d-8010-e2f86e1cabbf,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b00a74-9a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:71:89,bridge_name='br-int',has_traffic_filtering=True,id=92b00a74-9a51-477d-8010-e2f86e1cabbf,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b00a74-9a') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcbbbf1b-7b21-5585-a09e-dceebdd7bca1', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92b00a74-9a, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92b00a74-9a, col_values=(('qos', UUID('0fcc1adb-ef70-463e-9e25-70d46f2d3db8')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92b00a74-9a, col_values=(('external_ids', {'iface-id': '92b00a74-9a51-477d-8010-e2f86e1cabbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:71:89', 'vm-uuid': 'f867644d-af12-4b8b-be06-ff6c00344095'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: INFO os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:71:89,bridge_name='br-int',has_traffic_filtering=True,id=92b00a74-9a51-477d-8010-e2f86e1cabbf,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b00a74-9a')
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:9f:95,bridge_name='br-int',has_traffic_filtering=True,id=42a122d2-f18d-46a5-9b9b-fb60602bfe82,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a122d2-f1') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:9f:95,bridge_name='br-int',has_traffic_filtering=True,id=42a122d2-f18d-46a5-9b9b-fb60602bfe82,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a122d2-f1') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e629485d-343e-5bf5-b006-8162aefac9f2', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42a122d2-f1, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42a122d2-f1, col_values=(('qos', UUID('578d2bcc-b73a-4a9a-a44d-859943f67ecb')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42a122d2-f1, col_values=(('external_ids', {'iface-id': '42a122d2-f18d-46a5-9b9b-fb60602bfe82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:9f:95', 'vm-uuid': 'f867644d-af12-4b8b-be06-ff6c00344095'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: INFO os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:9f:95,bridge_name='br-int',has_traffic_filtering=True,id=42a122d2-f18d-46a5-9b9b-fb60602bfe82,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a122d2-f1')
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:29:52,bridge_name='br-int',has_traffic_filtering=True,id=f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ccc5fa-9e') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:29:52,bridge_name='br-int',has_traffic_filtering=True,id=f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ccc5fa-9e') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e84264b2-1da3-5b82-a73b-81d97871da85', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7ccc5fa-9e, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7ccc5fa-9e, col_values=(('qos', UUID('5630a1bc-133d-41fa-aefe-9bfe70661d2b')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7ccc5fa-9e, col_values=(('external_ids', {'iface-id': 'f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:29:52', 'vm-uuid': 'f867644d-af12-4b8b-be06-ff6c00344095'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:06 user nova-compute[75239]: INFO os_vif [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:29:52,bridge_name='br-int',has_traffic_filtering=True,id=f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ccc5fa-9e')
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] No BDM found with device name hda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] No VIF found with MAC fa:16:3e:02:55:08, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:38:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] No VIF found with MAC fa:16:3e:61:71:89, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:38:06 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Using config drive
Nov 13 20:38:07 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Creating config drive at /opt/stack/data/nova/instances/f867644d-af12-4b8b-be06-ff6c00344095/disk.config
Nov 13 20:38:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f867644d-af12-4b8b-be06-ff6c00344095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp16drdliu {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f867644d-af12-4b8b-be06-ff6c00344095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp16drdliu" returned: 0 in 0.053s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-fbefc332-a5ee-4cdf-a244-f71c10c08099 req-10b9e001-e0f6-41db-97f1-d926e6168274 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fbefc332-a5ee-4cdf-a244-f71c10c08099 req-10b9e001-e0f6-41db-97f1-d926e6168274 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fbefc332-a5ee-4cdf-a244-f71c10c08099 req-10b9e001-e0f6-41db-97f1-d926e6168274 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fbefc332-a5ee-4cdf-a244-f71c10c08099 req-10b9e001-e0f6-41db-97f1-d926e6168274 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-fbefc332-a5ee-4cdf-a244-f71c10c08099 req-10b9e001-e0f6-41db-97f1-d926e6168274 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:08 user nova-compute[75239]: WARNING nova.compute.manager [req-fbefc332-a5ee-4cdf-a244-f71c10c08099 req-10b9e001-e0f6-41db-97f1-d926e6168274 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-77d1bec8-0075-42a5-ae4c-85e20523b131 for instance with vm_state building and task_state spawning.
Nov 13 20:38:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-f7057f24-10c5-4fc7-9499-b7fbca4b57c7 req-5414a3db-32d3-4929-9974-d07a75e39feb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f7057f24-10c5-4fc7-9499-b7fbca4b57c7 req-5414a3db-32d3-4929-9974-d07a75e39feb service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f7057f24-10c5-4fc7-9499-b7fbca4b57c7 req-5414a3db-32d3-4929-9974-d07a75e39feb service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f7057f24-10c5-4fc7-9499-b7fbca4b57c7 req-5414a3db-32d3-4929-9974-d07a75e39feb service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-f7057f24-10c5-4fc7-9499-b7fbca4b57c7 req-5414a3db-32d3-4929-9974-d07a75e39feb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:09 user nova-compute[75239]: WARNING nova.compute.manager [req-f7057f24-10c5-4fc7-9499-b7fbca4b57c7 req-5414a3db-32d3-4929-9974-d07a75e39feb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 for instance with vm_state building and task_state spawning.
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-a4c7eaf2-b372-4358-95a0-a3428a45efba req-bc6c3329-ddfa-431d-8534-4eb80dfc2799 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a4c7eaf2-b372-4358-95a0-a3428a45efba req-bc6c3329-ddfa-431d-8534-4eb80dfc2799 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a4c7eaf2-b372-4358-95a0-a3428a45efba req-bc6c3329-ddfa-431d-8534-4eb80dfc2799 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a4c7eaf2-b372-4358-95a0-a3428a45efba req-bc6c3329-ddfa-431d-8534-4eb80dfc2799 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-a4c7eaf2-b372-4358-95a0-a3428a45efba req-bc6c3329-ddfa-431d-8534-4eb80dfc2799 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:10 user nova-compute[75239]: WARNING nova.compute.manager [req-a4c7eaf2-b372-4358-95a0-a3428a45efba req-bc6c3329-ddfa-431d-8534-4eb80dfc2799 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-92b00a74-9a51-477d-8010-e2f86e1cabbf for instance with vm_state building and task_state spawning.
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:10 user nova-compute[75239]: WARNING nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-77d1bec8-0075-42a5-ae4c-85e20523b131 for instance with vm_state building and task_state spawning.
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:10 user nova-compute[75239]: WARNING nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 for instance with vm_state building and task_state spawning.
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:10 user nova-compute[75239]: WARNING nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 for instance with vm_state building and task_state spawning.
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:10 user nova-compute[75239]: WARNING nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 for instance with vm_state building and task_state spawning.
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:10 user nova-compute[75239]: WARNING nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 for instance with vm_state building and task_state spawning.
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:10 user nova-compute[75239]: WARNING nova.compute.manager [req-7a575039-5de5-4a0a-8cdf-7e9b52fdb6a5 req-c49627a2-5141-4465-a37e-35a5dc0d97c8 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 for instance with vm_state building and task_state spawning.
Nov 13 20:38:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:11 user nova-compute[75239]: WARNING nova.compute.manager [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 for instance with vm_state building and task_state spawning.
Nov 13 20:38:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:11 user nova-compute[75239]: WARNING nova.compute.manager [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 for instance with vm_state building and task_state spawning.
Nov 13 20:38:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:11 user nova-compute[75239]: WARNING nova.compute.manager [req-1978b48c-403f-410b-803b-a609e83e3b29 req-4d09ae78-3d7d-4583-934a-0ee11008f2bb service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 for instance with vm_state building and task_state spawning.
Nov 13 20:38:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'flavor' on Instance uuid 55f96b7f-454c-440a-9c78-f91305569e87 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:12 user nova-compute[75239]: INFO nova.compute.manager [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Attaching volume f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d to /dev/vdb
Nov 13 20:38:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-487a100f-29ed-48fa-a05c-7de275c8be09 req-b56c00e2-eaab-4d20-9206-9a5bc45e47a7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-487a100f-29ed-48fa-a05c-7de275c8be09 req-b56c00e2-eaab-4d20-9206-9a5bc45e47a7 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-487a100f-29ed-48fa-a05c-7de275c8be09 req-b56c00e2-eaab-4d20-9206-9a5bc45e47a7 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-487a100f-29ed-48fa-a05c-7de275c8be09 req-b56c00e2-eaab-4d20-9206-9a5bc45e47a7 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-487a100f-29ed-48fa-a05c-7de275c8be09 req-b56c00e2-eaab-4d20-9206-9a5bc45e47a7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:12 user nova-compute[75239]: WARNING nova.compute.manager [req-487a100f-29ed-48fa-a05c-7de275c8be09 req-b56c00e2-eaab-4d20-9206-9a5bc45e47a7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-92b00a74-9a51-477d-8010-e2f86e1cabbf for instance with vm_state building and task_state spawning.
Nov 13 20:38:12 user nova-compute[75239]: DEBUG os_brick.utils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2726105b-d447-48ad-82e7-3a2574198367]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec0c736-bd66-4b8b-b6ef-3e055dfd8d61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[967465cd-d0b6-41df-bb9e-6ac7bbbfef0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f3f03b-153d-40d9-9f73-67672fc31240]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:38:12 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:38:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[adef883b-e83f-4c01-9ede-7996833b61c6]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG os_brick.utils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Updating existing volume attachment record: 47377331-6ed6-420b-b0a9-fe84f637ede4 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:38:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:38:12 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance spawned successfully.
Nov 13 20:38:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-c89088e0-36da-4210-bdf7-4abb9345d375 req-31575f12-8c2f-4b96-bf80-6bfec15c728c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c89088e0-36da-4210-bdf7-4abb9345d375 req-31575f12-8c2f-4b96-bf80-6bfec15c728c service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c89088e0-36da-4210-bdf7-4abb9345d375 req-31575f12-8c2f-4b96-bf80-6bfec15c728c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c89088e0-36da-4210-bdf7-4abb9345d375 req-31575f12-8c2f-4b96-bf80-6bfec15c728c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-c89088e0-36da-4210-bdf7-4abb9345d375 req-31575f12-8c2f-4b96-bf80-6bfec15c728c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:13 user nova-compute[75239]: WARNING nova.compute.manager [req-c89088e0-36da-4210-bdf7-4abb9345d375 req-31575f12-8c2f-4b96-bf80-6bfec15c728c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 for instance with vm_state building and task_state spawning.
Nov 13 20:38:13 user nova-compute[75239]: INFO nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Took 11.17 seconds to spawn the instance on the hypervisor.
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:38:13 user nova-compute[75239]: INFO nova.compute.manager [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Took 25.97 seconds to build instance.
Nov 13 20:38:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f7c3ff3f-ee07-4d7a-b2b9-7263a130c4cf tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "f867644d-af12-4b8b-be06-ff6c00344095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.061s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-74b16f78-9293-43dd-9497-1aae3e381f9b req-9b683b15-e67d-4f6d-8d6d-3efce7056c62 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-changed-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-74b16f78-9293-43dd-9497-1aae3e381f9b req-9b683b15-e67d-4f6d-8d6d-3efce7056c62 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Refreshing instance network info cache due to event network-changed-6563fee0-5628-49c4-b7f9-fb4799a36f70. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-74b16f78-9293-43dd-9497-1aae3e381f9b req-9b683b15-e67d-4f6d-8d6d-3efce7056c62 service nova] Acquiring lock "refresh_cache-55f96b7f-454c-440a-9c78-f91305569e87" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-74b16f78-9293-43dd-9497-1aae3e381f9b req-9b683b15-e67d-4f6d-8d6d-3efce7056c62 service nova] Acquired lock "refresh_cache-55f96b7f-454c-440a-9c78-f91305569e87" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-74b16f78-9293-43dd-9497-1aae3e381f9b req-9b683b15-e67d-4f6d-8d6d-3efce7056c62 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Refreshing network info cache for port 6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-74b16f78-9293-43dd-9497-1aae3e381f9b req-9b683b15-e67d-4f6d-8d6d-3efce7056c62 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Updated VIF entry in instance network info cache for port 6563fee0-5628-49c4-b7f9-fb4799a36f70. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-74b16f78-9293-43dd-9497-1aae3e381f9b req-9b683b15-e67d-4f6d-8d6d-3efce7056c62 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Updating instance_info_cache with network_info: [{"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:38:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-74b16f78-9293-43dd-9497-1aae3e381f9b req-9b683b15-e67d-4f6d-8d6d-3efce7056c62 service nova] Releasing lock "refresh_cache-55f96b7f-454c-440a-9c78-f91305569e87" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:16 user nova-compute[75239]: INFO nova.compute.manager [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Detaching volume 211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:38:16 user nova-compute[75239]: INFO nova.virt.block_device [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Attempting to driver detach volume 211604d0-2297-4169-9d9f-1034e5ff23b0 from mountpoint /dev/vdb
Nov 13 20:38:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Attempting to detach device vdb from instance f59ce508-2487-4e71-8c09-ffd17dd0eafc from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:38:16 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:16 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:38:16 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:38:16 user nova-compute[75239]:   <serial>211604d0-2297-4169-9d9f-1034e5ff23b0</serial>
Nov 13 20:38:16 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 20:38:16 user nova-compute[75239]: </disk>
Nov 13 20:38:16 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:38:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully detached device vdb from instance f59ce508-2487-4e71-8c09-ffd17dd0eafc from the persistent domain config.
Nov 13 20:38:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f59ce508-2487-4e71-8c09-ffd17dd0eafc from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:38:16 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:16 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:38:16 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:38:16 user nova-compute[75239]:   <serial>211604d0-2297-4169-9d9f-1034e5ff23b0</serial>
Nov 13 20:38:16 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 20:38:16 user nova-compute[75239]: </disk>
Nov 13 20:38:16 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USVaEvyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:16 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:16 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:16 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc0cf79-238a-4003-98cf-7f6b74579820]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:38:16 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b31097d-3498-424d-b2ce-8001fc60e356]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d] added
Nov 13 20:38:16 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dfc822-d6ae-4a71-8b74-4ad3b4d615d3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5835d587-dbd7-43bc-a402-455796725f46]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USVaEvyj {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USVaEvyj" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[50afe09e-075d-412e-92c5-b927e53712f6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'USVaEvyj'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b5c5c4-4233-42f1-b717-294276c1f6f3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f23e1c-3c28-4de1-8c8c-b761a93afbe6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:16 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:16 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:16 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[801157f4-eaf1-46f2-892d-798a937fd860]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260]
Nov 13 20:38:17 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260] successful.
Nov 13 20:38:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[64612fbb-9bdd-47e7-a194-641ddc06300b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b0b51e-8315-4fde-abdc-9c47cb75759b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:17 user nova-compute[75239]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] HCTL ('40', '-', '-', 0) found on session 21 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e170c78d-7f84-4d85-b13b-fff72f717fed]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching for a device in session 21 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USVaEvyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:38:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23637373331336230', 'path': '/dev/sdi'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373331336230', 'path': '/dev/sdi'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:38:18 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'flavor' on Instance uuid 55f96b7f-454c-440a-9c78-f91305569e87 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:38:18 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:18 user nova-compute[75239]:   <source dev="/dev/sdi"/>
Nov 13 20:38:18 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:38:18 user nova-compute[75239]:   <serial>f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d</serial>
Nov 13 20:38:18 user nova-compute[75239]: </disk>
Nov 13 20:38:18 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:38:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:38:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:38:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No VIF found with MAC fa:16:3e:12:8f:22, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:38:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e8c97063-5c39-439d-8e83-d9bab18a5145 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.510s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:20 user nova-compute[75239]: INFO nova.compute.manager [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Rebuilding instance
Nov 13 20:38:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:38:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-79783254-8392-42c0-aa86-8a79986c6f80 req-6bdcfa44-4c52-42f0-a64c-ab0f4b35323d service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-unplugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-79783254-8392-42c0-aa86-8a79986c6f80 req-6bdcfa44-4c52-42f0-a64c-ab0f4b35323d service nova] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-79783254-8392-42c0-aa86-8a79986c6f80 req-6bdcfa44-4c52-42f0-a64c-ab0f4b35323d service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-79783254-8392-42c0-aa86-8a79986c6f80 req-6bdcfa44-4c52-42f0-a64c-ab0f4b35323d service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-79783254-8392-42c0-aa86-8a79986c6f80 req-6bdcfa44-4c52-42f0-a64c-ab0f4b35323d service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] No waiting events found dispatching network-vif-unplugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:21 user nova-compute[75239]: WARNING nova.compute.manager [req-79783254-8392-42c0-aa86-8a79986c6f80 req-6bdcfa44-4c52-42f0-a64c-ab0f4b35323d service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received unexpected event network-vif-unplugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 for instance with vm_state active and task_state rebuilding.
Nov 13 20:38:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:21 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Instance destroyed successfully.
Nov 13 20:38:22 user nova-compute[75239]: INFO nova.compute.manager [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Detaching volume f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:38:22 user nova-compute[75239]: INFO nova.virt.block_device [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Attempting to driver detach volume f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d from mountpoint /dev/vdb
Nov 13 20:38:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Attempting to detach device vdb from instance 55f96b7f-454c-440a-9c78-f91305569e87 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:38:22 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:22 user nova-compute[75239]:   <source dev="/dev/sdi"/>
Nov 13 20:38:22 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:38:22 user nova-compute[75239]:   <serial>f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d</serial>
Nov 13 20:38:22 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:38:22 user nova-compute[75239]: </disk>
Nov 13 20:38:22 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:38:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully detached device vdb from instance 55f96b7f-454c-440a-9c78-f91305569e87 from the persistent domain config.
Nov 13 20:38:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USVaEvyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:22 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[26faece2-0bc3-498d-a4a7-ef786f9f1ac6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:38:22 user nova-compute[75239]: No targets found.
Nov 13 20:38:22 user nova-compute[75239]: iSNS:
Nov 13 20:38:22 user nova-compute[75239]: No targets found.
Nov 13 20:38:22 user nova-compute[75239]: STATIC:
Nov 13 20:38:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:38:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:38:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:38:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030
Nov 13 20:38:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:38:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a
Nov 13 20:38:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:38:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c
Nov 13 20:38:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:22 user nova-compute[75239]: FIRMWARE:
Nov 13 20:38:22 user nova-compute[75239]: No targets found.
Nov 13 20:38:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:38:22 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:38:22 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7913d72-09c4-4417-a5cb-ffb412d0405a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec7ea8c-6598-47a6-8e01-79f1b3b9b454]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:22 user nova-compute[75239]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60598d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d'): ({'sdi'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Removing single pathed devices sdi {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c658ff-4c91-4740-80fe-f550204236a6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed4a272-2cb7-4af4-a33d-76dc30407d3c]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flushing IO for device /dev/sdi {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0bace3-15c9-47d2-9449-2fae1857c31e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ea16b4-b11d-4f96-9fb9-c57226a22a41]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] SCSI volumes sdi have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aac69eb-e1c5-4e10-bae8-188c3ee6cd91]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b428d9-5bc3-49e6-81eb-d197c27b8a48]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260]
Nov 13 20:38:22 user nova-compute[75239]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260] successful.
Nov 13 20:38:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed22b8-67a4-499c-bcd7-fed48e861ad6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== disconnect_volume: return (365ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:38:23 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Instance destroyed successfully.
Nov 13 20:38:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2064952916',display_name='tempest-ServerActionsTestOtherA-server-1681381996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2064952916',id=15,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKe5xKWesSL7Xw6hcWc4RxdUahUkI+jkhDI4apiyCjXCfdLyQGOUt2pNUDacBxYeCp79YzytY/4Z4U7ALB2dqrqOE/L6p+WHD/S3QIse6iYs3wKwrVsyDyEByaRhcB+ag==',key_name='tempest-keypair-403991548',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:36:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-1gj70kp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:38:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=55f96b7f-454c-440a-9c78-f91305569e87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_vif [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6563fee0-56, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f59c7429-f85b-497b-9cb6-9d80a65e7cce) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:23 user nova-compute[75239]: INFO os_vif [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56')
Nov 13 20:38:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USVaEvyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:23 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28cbfa5-f76c-4e8e-9389-ab83746c41cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:38:23 user nova-compute[75239]: No targets found.
Nov 13 20:38:23 user nova-compute[75239]: iSNS:
Nov 13 20:38:23 user nova-compute[75239]: No targets found.
Nov 13 20:38:23 user nova-compute[75239]: STATIC:
Nov 13 20:38:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:38:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:38:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030
Nov 13 20:38:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:38:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a
Nov 13 20:38:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:38:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c
Nov 13 20:38:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:23 user nova-compute[75239]: FIRMWARE:
Nov 13 20:38:23 user nova-compute[75239]: No targets found.
Nov 13 20:38:23 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:38:23 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:38:23 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[04779580-c5a5-4ea2-86dd-72f386072a86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad96298-f189-4f9a-a7c2-c3ee9acdecac]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:23 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:23 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:23 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605d3be0>, {}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Disconnecting from: [] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.098s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== disconnect_volume: return (99ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:38:23 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Deleting instance files /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87_del
Nov 13 20:38:23 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Deletion of /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87_del complete
Nov 13 20:38:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-39995a4f-cb07-498d-9913-adc405947960 req-84228ef7-b084-4eaa-a3dd-a17a9d33b1d6 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-39995a4f-cb07-498d-9913-adc405947960 req-84228ef7-b084-4eaa-a3dd-a17a9d33b1d6 service nova] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-39995a4f-cb07-498d-9913-adc405947960 req-84228ef7-b084-4eaa-a3dd-a17a9d33b1d6 service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-39995a4f-cb07-498d-9913-adc405947960 req-84228ef7-b084-4eaa-a3dd-a17a9d33b1d6 service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-39995a4f-cb07-498d-9913-adc405947960 req-84228ef7-b084-4eaa-a3dd-a17a9d33b1d6 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] No waiting events found dispatching network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:23 user nova-compute[75239]: WARNING nova.compute.manager [req-39995a4f-cb07-498d-9913-adc405947960 req-84228ef7-b084-4eaa-a3dd-a17a9d33b1d6 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received unexpected event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 for instance with vm_state active and task_state rebuilding.
Nov 13 20:38:23 user nova-compute[75239]: INFO nova.virt.block_device [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Booting with volume f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d at /dev/vdb
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.utils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52be7f8-2414-4381-bddc-42dfd851dbd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe791eb-bda7-47c8-a5ea-9d0a02f7e3c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae2f7df-d30c-4a1e-b3cc-f49daf555280]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f162467-30f2-4dc7-a7b1-2ae9eecd01c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:38:23 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:38:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3155f1c8-2460-4865-8e66-92942e0e90db]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG os_brick.utils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:23 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Updating existing volume attachment record: ed65ad9d-cf12-4c9f-bb7a-101afbba2aef {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:38:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 20:38:25 user nova-compute[75239]: INFO nova.compute.manager [None req-0a441999-fd4e-4130-9eff-607304cf960d tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Unrescuing
Nov 13 20:38:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0a441999-fd4e-4130-9eff-607304cf960d tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0a441999-fd4e-4130-9eff-607304cf960d tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquired lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0a441999-fd4e-4130-9eff-607304cf960d tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0a441999-fd4e-4130-9eff-607304cf960d tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating instance_info_cache with network_info: [{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0a441999-fd4e-4130-9eff-607304cf960d tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Releasing lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG nova.objects.instance [None req-0a441999-fd4e-4130-9eff-607304cf960d tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'flavor' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-c9fe9dab-94be-44f7-a3c9-fc7d441c3f82 req-e5f6d877-bd16-4792-a8c8-ee988b4694a9 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-unplugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c9fe9dab-94be-44f7-a3c9-fc7d441c3f82 req-e5f6d877-bd16-4792-a8c8-ee988b4694a9 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c9fe9dab-94be-44f7-a3c9-fc7d441c3f82 req-e5f6d877-bd16-4792-a8c8-ee988b4694a9 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c9fe9dab-94be-44f7-a3c9-fc7d441c3f82 req-e5f6d877-bd16-4792-a8c8-ee988b4694a9 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-c9fe9dab-94be-44f7-a3c9-fc7d441c3f82 req-e5f6d877-bd16-4792-a8c8-ee988b4694a9 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-unplugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:26 user nova-compute[75239]: WARNING nova.compute.manager [req-c9fe9dab-94be-44f7-a3c9-fc7d441c3f82 req-e5f6d877-bd16-4792-a8c8-ee988b4694a9 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-unplugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:38:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-a254007f-353e-4d8e-b2b3-267e636e40dd req-819b7e7b-20f7-43c4-9f6a-849215139d3f service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-changed-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-a254007f-353e-4d8e-b2b3-267e636e40dd req-819b7e7b-20f7-43c4-9f6a-849215139d3f service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Refreshing instance network info cache due to event network-changed-8e91bea0-dea9-49f6-ac95-f485a29d5cd2. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a254007f-353e-4d8e-b2b3-267e636e40dd req-819b7e7b-20f7-43c4-9f6a-849215139d3f service nova] Acquiring lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a254007f-353e-4d8e-b2b3-267e636e40dd req-819b7e7b-20f7-43c4-9f6a-849215139d3f service nova] Acquired lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:38:26 user nova-compute[75239]: DEBUG nova.network.neutron [req-a254007f-353e-4d8e-b2b3-267e636e40dd req-819b7e7b-20f7-43c4-9f6a-849215139d3f service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Refreshing network info cache for port 8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:38:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Instance destroyed successfully.
Nov 13 20:38:27 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG nova.network.neutron [req-a254007f-353e-4d8e-b2b3-267e636e40dd req-819b7e7b-20f7-43c4-9f6a-849215139d3f service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updated VIF entry in instance network info cache for port 8e91bea0-dea9-49f6-ac95-f485a29d5cd2. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG nova.network.neutron [req-a254007f-353e-4d8e-b2b3-267e636e40dd req-819b7e7b-20f7-43c4-9f6a-849215139d3f service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating instance_info_cache with network_info: [{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a254007f-353e-4d8e-b2b3-267e636e40dd req-819b7e7b-20f7-43c4-9f6a-849215139d3f service nova] Releasing lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-d6dee708-10a8-461f-878a-ef6ae6862f03 req-e64da67e-af33-4de4-b5aa-c5025b494859 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-changed-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-d6dee708-10a8-461f-878a-ef6ae6862f03 req-e64da67e-af33-4de4-b5aa-c5025b494859 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Refreshing instance network info cache due to event network-changed-37dadfef-e9b8-45fe-a9f2-901e412a21d0. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d6dee708-10a8-461f-878a-ef6ae6862f03 req-e64da67e-af33-4de4-b5aa-c5025b494859 service nova] Acquiring lock "refresh_cache-1fe94db5-cf69-4e80-a779-e2182588ab56" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d6dee708-10a8-461f-878a-ef6ae6862f03 req-e64da67e-af33-4de4-b5aa-c5025b494859 service nova] Acquired lock "refresh_cache-1fe94db5-cf69-4e80-a779-e2182588ab56" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:38:27 user nova-compute[75239]: DEBUG nova.network.neutron [req-d6dee708-10a8-461f-878a-ef6ae6862f03 req-e64da67e-af33-4de4-b5aa-c5025b494859 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Refreshing network info cache for port 37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-4d9df056-87da-44ca-9234-2346affa6966 req-3388bd4f-2f9c-4e48-8636-80c7aa2d7ab8 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4d9df056-87da-44ca-9234-2346affa6966 req-3388bd4f-2f9c-4e48-8636-80c7aa2d7ab8 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4d9df056-87da-44ca-9234-2346affa6966 req-3388bd4f-2f9c-4e48-8636-80c7aa2d7ab8 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4d9df056-87da-44ca-9234-2346affa6966 req-3388bd4f-2f9c-4e48-8636-80c7aa2d7ab8 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-4d9df056-87da-44ca-9234-2346affa6966 req-3388bd4f-2f9c-4e48-8636-80c7aa2d7ab8 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:28 user nova-compute[75239]: WARNING nova.compute.manager [req-4d9df056-87da-44ca-9234-2346affa6966 req-3388bd4f-2f9c-4e48-8636-80c7aa2d7ab8 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:38:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-d6dee708-10a8-461f-878a-ef6ae6862f03 req-e64da67e-af33-4de4-b5aa-c5025b494859 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Updated VIF entry in instance network info cache for port 37dadfef-e9b8-45fe-a9f2-901e412a21d0. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-d6dee708-10a8-461f-878a-ef6ae6862f03 req-e64da67e-af33-4de4-b5aa-c5025b494859 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Updating instance_info_cache with network_info: [{"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d6dee708-10a8-461f-878a-ef6ae6862f03 req-e64da67e-af33-4de4-b5aa-c5025b494859 service nova] Releasing lock "refresh_cache-1fe94db5-cf69-4e80-a779-e2182588ab56" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-3dd7fb2a-c912-40ab-8694-3ad045b9d7ce req-7e33f3cd-251e-441d-a54b-7c3ba0a4ff3e service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-changed-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-3dd7fb2a-c912-40ab-8694-3ad045b9d7ce req-7e33f3cd-251e-441d-a54b-7c3ba0a4ff3e service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Refreshing instance network info cache due to event network-changed-8e91bea0-dea9-49f6-ac95-f485a29d5cd2. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3dd7fb2a-c912-40ab-8694-3ad045b9d7ce req-7e33f3cd-251e-441d-a54b-7c3ba0a4ff3e service nova] Acquiring lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3dd7fb2a-c912-40ab-8694-3ad045b9d7ce req-7e33f3cd-251e-441d-a54b-7c3ba0a4ff3e service nova] Acquired lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-3dd7fb2a-c912-40ab-8694-3ad045b9d7ce req-7e33f3cd-251e-441d-a54b-7c3ba0a4ff3e service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Refreshing network info cache for port 8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:38:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Creating image(s)
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.546s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:29 user nova-compute[75239]: INFO nova.compute.manager [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Rebuilding instance
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk 1073741824" returned: 0 in 0.144s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.205s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Cannot resize image /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Ensure instance console log exists: /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Start _get_guest_xml network_info=[{"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ed65ad9d-cf12-4c9f-bb7a-101afbba2aef', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USVaEvyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '55f96b7f-454c-440a-9c78-f91305569e87', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 'serial': 'f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-3dd7fb2a-c912-40ab-8694-3ad045b9d7ce req-7e33f3cd-251e-441d-a54b-7c3ba0a4ff3e service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updated VIF entry in instance network info cache for port 8e91bea0-dea9-49f6-ac95-f485a29d5cd2. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-3dd7fb2a-c912-40ab-8694-3ad045b9d7ce req-7e33f3cd-251e-441d-a54b-7c3ba0a4ff3e service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating instance_info_cache with network_info: [{"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:38:30 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 20:38:30 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'vcpu_model' on Instance uuid 55f96b7f-454c-440a-9c78-f91305569e87 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3dd7fb2a-c912-40ab-8694-3ad045b9d7ce req-7e33f3cd-251e-441d-a54b-7c3ba0a4ff3e service nova] Releasing lock "refresh_cache-d67fcb6b-fb37-4d04-8dab-d74370f76981" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USVaEvyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:30 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:30 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:30 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf8fbdb-386f-4c20-af8c-652e1cd931dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:38:30 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7b6f42-dec5-4abe-aed9-472fb0b60cd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d] added
Nov 13 20:38:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[989c7248-8386-48d7-ac3b-125876c603f4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:30 user nova-compute[75239]: WARNING nova.compute.manager [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:30 user nova-compute[75239]: WARNING nova.compute.manager [req-6bdff16f-6284-403c-9bf6-a755f15d6b79 req-76795b95-27d0-4fd2-a9b3-5c0640c1f7e7 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af66e3f-5f2c-44c7-80c3-61dc856987e7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USVaEvyj {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v USVaEvyj" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f90c4-c326-4cac-b326-5e4264cb33d6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'USVaEvyj'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6d9c5c-edea-47cb-9d55-153718a5f79f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2584e9-4e96-45e6-84ab-bc6f4a68bc17]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[549cd163-bda7-4a99-ac9c-add54aa798b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260]
Nov 13 20:38:30 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260] successful.
Nov 13 20:38:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:30 user nova-compute[75239]: INFO nova.compute.manager [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Terminating instance
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbce647-265e-4b57-84e1-a69af0f7c99f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b86184c-66ea-4b0f-a9e7-57ad64a2ec69]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:30 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.512s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] HCTL ('40', '-', '-', 0) found on session 22 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-unplugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-unplugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:30 user nova-compute[75239]: WARNING nova.compute.manager [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-unplugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state active and task_state rebuilding.
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:30 user nova-compute[75239]: WARNING nova.compute.manager [req-e4a3d421-d0e5-42e9-9bc9-761908d7cdf0 req-beb34d32-852a-48be-9621-9ffad3d0cd06 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state active and task_state rebuilding.
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1057b3-f0b0-4a6d-9047-35e55217344c]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching for a device in session 22 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USVaEvyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance destroyed successfully.
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0a441999-fd4e-4130-9eff-607304cf960d tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance destroyed successfully.
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-364989443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-80459434',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4bTkMByBBN86gQLJ0njqwBvWR0XDRjrFeM5rsfRs/jEsAUVgdGRCe/qEZj7jheAmcMs60nSNIENVVJ15Le3mNrjiOZ1ooTGgvR6HWSRyk2+0hsYobO++zcjvL8uksDpg==',key_name='tempest-keypair-1832288825',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:36:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='100038f3462149338c8baaefb89970e5',ramdisk_id='',reservation_id='r-cyw07hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-403999266',owner_user_name='tempest-ServerActionsV293TestJSON-403999266-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:38:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0adecc32b22a4d7a910320d9f6c4f2ee',uuid=1fe94db5-cf69-4e80-a779-e2182588ab56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converting VIF {"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_vif [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37dadfef-e9, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c63c173-c99c-4207-a853-01e7047c496b) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:30 user nova-compute[75239]: INFO os_vif [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9')
Nov 13 20:38:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzyCURQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:30 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 20:38:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Instance destroyed successfully.
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lazy-loading 'resources' on Instance uuid ae8531d9-3930-4373-91b2-628d850e8ba7 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1368869872',display_name='tempest-VolumesAdminNegativeTest-server-1368869872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1368869872',id=6,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfi+bbzoY150SRmMbpbpUG0AgdZjRyoN52REv5In3OeDpxG0Szy5ziB2DjupfYCUs1xMy41cA8vRxYXO2ehkMMy2qXMfv2b1AqD2RyHfWREKj4ToppHWnJVGhOPrRyXrg==',key_name='tempest-keypair-1874323935',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:33:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='edd5f6a62ab945aead252eec2f72112b',ramdisk_id='',reservation_id='r-gmvgd2sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1388057922',owner_user_name='tempest-VolumesAdminNegativeTest-1388057922-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='781343c1a6e94234bef9a8d11cea0f9c',uuid=ae8531d9-3930-4373-91b2-628d850e8ba7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converting VIF {"id": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "address": "fa:16:3e:25:da:7a", "network": {"id": "cc504004-bca5-4aea-aa68-15bcc430309a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1986489685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "edd5f6a62ab945aead252eec2f72112b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7bfe0e9-fe", "ovs_interfaceid": "d7bfe0e9-fe15-4a8f-b258-e0ab32209397", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:da:7a,bridge_name='br-int',has_traffic_filtering=True,id=d7bfe0e9-fe15-4a8f-b258-e0ab32209397,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bfe0e9-fe') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_vif [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:da:7a,bridge_name='br-int',has_traffic_filtering=True,id=d7bfe0e9-fe15-4a8f-b258-e0ab32209397,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bfe0e9-fe') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7bfe0e9-fe, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b4dceee-ddef-4d5f-885b-f4da212aefff) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: INFO os_vif [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:da:7a,bridge_name='br-int',has_traffic_filtering=True,id=d7bfe0e9-fe15-4a8f-b258-e0ab32209397,network=Network(cc504004-bca5-4aea-aa68-15bcc430309a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7bfe0e9-fe')
Nov 13 20:38:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Deleting instance files /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7_del
Nov 13 20:38:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Deletion of /opt/stack/data/nova/instances/ae8531d9-3930-4373-91b2-628d850e8ba7_del complete
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: INFO nova.compute.manager [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.577s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== connect_volume: return (1579ms) {'type': 'block', 'scsi_wwn': '23637373331336230', 'path': '/dev/sdi'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637373331336230', 'path': '/dev/sdi'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.765s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce3922d-afa5-4561-aa41-18028263cac6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:38:31 user nova-compute[75239]: No targets found.
Nov 13 20:38:31 user nova-compute[75239]: iSNS:
Nov 13 20:38:31 user nova-compute[75239]: No targets found.
Nov 13 20:38:31 user nova-compute[75239]: STATIC:
Nov 13 20:38:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:38:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:38:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:38:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030
Nov 13 20:38:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:38:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a
Nov 13 20:38:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:38:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c
Nov 13 20:38:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:31 user nova-compute[75239]: FIRMWARE:
Nov 13 20:38:31 user nova-compute[75239]: No targets found.
Nov 13 20:38:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:38:31 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:38:31 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeae002-58cf-4af9-a5db-0a038bba4753]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2064952916',display_name='tempest-ServerActionsTestOtherA-server-1681381996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2064952916',id=15,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKe5xKWesSL7Xw6hcWc4RxdUahUkI+jkhDI4apiyCjXCfdLyQGOUt2pNUDacBxYeCp79YzytY/4Z4U7ALB2dqrqOE/L6p+WHD/S3QIse6iYs3wKwrVsyDyEByaRhcB+ag==',key_name='tempest-keypair-403991548',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:36:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-1gj70kp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=55f96b7f-454c-440a-9c78-f91305569e87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:38:31 user nova-compute[75239]:   <uuid>55f96b7f-454c-440a-9c78-f91305569e87</uuid>
Nov 13 20:38:31 user nova-compute[75239]:   <name>instance-0000000f</name>
Nov 13 20:38:31 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:38:31 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:38:31 user nova-compute[75239]:   <metadata>
Nov 13 20:38:31 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:38:31 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:38:31 user nova-compute[75239]:       <nova:name>tempest-ServerActionsTestOtherA-server-1681381996</nova:name>
Nov 13 20:38:31 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:38:30</nova:creationTime>
Nov 13 20:38:31 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:38:31 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:38:31 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:38:31 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:38:31 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:38:31 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:38:31 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:38:31 user nova-compute[75239]:       <nova:owner>
Nov 13 20:38:31 user nova-compute[75239]:         <nova:user uuid="3d8ae2d158f94548bc3d9873317935cd">tempest-ServerActionsTestOtherA-1210141142-project-member</nova:user>
Nov 13 20:38:31 user nova-compute[75239]:         <nova:project uuid="e14ce616b1ad4ee7934e34bad1fdf6a3">tempest-ServerActionsTestOtherA-1210141142</nova:project>
Nov 13 20:38:31 user nova-compute[75239]:       </nova:owner>
Nov 13 20:38:31 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:38:31 user nova-compute[75239]:       <nova:ports>
Nov 13 20:38:31 user nova-compute[75239]:         <nova:port uuid="6563fee0-5628-49c4-b7f9-fb4799a36f70">
Nov 13 20:38:31 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:38:31 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:31 user nova-compute[75239]:       </nova:ports>
Nov 13 20:38:31 user nova-compute[75239]:     </nova:instance>
Nov 13 20:38:31 user nova-compute[75239]:   </metadata>
Nov 13 20:38:31 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:38:31 user nova-compute[75239]:     <system>
Nov 13 20:38:31 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:38:31 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:38:31 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:38:31 user nova-compute[75239]:       <entry name="serial">55f96b7f-454c-440a-9c78-f91305569e87</entry>
Nov 13 20:38:31 user nova-compute[75239]:       <entry name="uuid">55f96b7f-454c-440a-9c78-f91305569e87</entry>
Nov 13 20:38:31 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:38:31 user nova-compute[75239]:     </system>
Nov 13 20:38:31 user nova-compute[75239]:   </sysinfo>
Nov 13 20:38:31 user nova-compute[75239]:   <os>
Nov 13 20:38:31 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:38:31 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:38:31 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:38:31 user nova-compute[75239]:   </os>
Nov 13 20:38:31 user nova-compute[75239]:   <features>
Nov 13 20:38:31 user nova-compute[75239]:     <acpi/>
Nov 13 20:38:31 user nova-compute[75239]:     <apic/>
Nov 13 20:38:31 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:38:31 user nova-compute[75239]:   </features>
Nov 13 20:38:31 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:38:31 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:38:31 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:38:31 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:38:31 user nova-compute[75239]:   </clock>
Nov 13 20:38:31 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:38:31 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:38:31 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:38:31 user nova-compute[75239]:   </cpu>
Nov 13 20:38:31 user nova-compute[75239]:   <devices>
Nov 13 20:38:31 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:38:31 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:38:31 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk"/>
Nov 13 20:38:31 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:38:31 user nova-compute[75239]:     </disk>
Nov 13 20:38:31 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:38:31 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:31 user nova-compute[75239]:       <source dev="/dev/sdi"/>
Nov 13 20:38:31 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:38:31 user nova-compute[75239]:       <serial>f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d</serial>
Nov 13 20:38:31 user nova-compute[75239]:     </disk>
Nov 13 20:38:31 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:31 user nova-compute[75239]:       <mac address="fa:16:3e:12:8f:22"/>
Nov 13 20:38:31 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:31 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:31 user nova-compute[75239]:       <target dev="tap6563fee0-56"/>
Nov 13 20:38:31 user nova-compute[75239]:     </interface>
Nov 13 20:38:31 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:38:31 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/console.log" append="off"/>
Nov 13 20:38:31 user nova-compute[75239]:     </serial>
Nov 13 20:38:31 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:38:31 user nova-compute[75239]:     <video>
Nov 13 20:38:31 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:31 user nova-compute[75239]:     </video>
Nov 13 20:38:31 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:38:31 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:38:31 user nova-compute[75239]:     </rng>
Nov 13 20:38:31 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:38:31 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:38:31 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:38:31 user nova-compute[75239]:     </memballoon>
Nov 13 20:38:31 user nova-compute[75239]:   </devices>
Nov 13 20:38:31 user nova-compute[75239]: </domain>
Nov 13 20:38:31 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2064952916',display_name='tempest-ServerActionsTestOtherA-server-1681381996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2064952916',id=15,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKe5xKWesSL7Xw6hcWc4RxdUahUkI+jkhDI4apiyCjXCfdLyQGOUt2pNUDacBxYeCp79YzytY/4Z4U7ALB2dqrqOE/L6p+WHD/S3QIse6iYs3wKwrVsyDyEByaRhcB+ag==',key_name='tempest-keypair-403991548',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:36:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-1gj70kp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=55f96b7f-454c-440a-9c78-f91305569e87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_vif [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[385e7e17-c86b-47b2-8a90-e5a8f5d0eb57]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:31 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8424e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f'): ({'sde'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Removing single pathed devices sde {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ed3f3e5-bfff-5adf-b03b-2ba0936325c0', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6563fee0-56, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6563fee0-56, col_values=(('qos', UUID('005d7683-9ec2-481d-92f3-264c2faa8a91')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6563fee0-56, col_values=(('external_ids', {'iface-id': '6563fee0-5628-49c4-b7f9-fb4799a36f70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:8f:22', 'vm-uuid': '55f96b7f-454c-440a-9c78-f91305569e87'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee7a766-adca-418d-9bdb-4edf482fd6e4]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:31 user nova-compute[75239]: INFO os_vif [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56')
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67666f7-80f5-41df-9026-15d9e0064fa1]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Flushing IO for device /dev/sde {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.058s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c1a17-eb14-48cc-8655-7fd3219703d2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No VIF found with MAC fa:16:3e:12:8f:22, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bfe771-7b9d-4bc8-82c6-2c157d83d3a2]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c335a8d5-b340-484d-bd1e-47a734c360ea]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79608a5-05d7-46b4-a7b0-c6f1436b0c55]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260]
Nov 13 20:38:32 user nova-compute[75239]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260] successful.
Nov 13 20:38:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f103b96f-5d46-46dc-bf80-f11c61546f90]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.624s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] <== disconnect_volume: return (1389ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:38:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Deleting instance files /opt/stack/data/nova/instances/1fe94db5-cf69-4e80-a779-e2182588ab56_del
Nov 13 20:38:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Deletion of /opt/stack/data/nova/instances/1fe94db5-cf69-4e80-a779-e2182588ab56_del complete
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-4b32acfe-9524-4c1e-9a84-d5053770a77c req-f756c0fa-3c63-4d04-b464-c6731a427f27 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received event network-vif-deleted-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:32 user nova-compute[75239]: INFO nova.compute.manager [req-4b32acfe-9524-4c1e-9a84-d5053770a77c req-f756c0fa-3c63-4d04-b464-c6731a427f27 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Neutron deleted interface d7bfe0e9-fe15-4a8f-b258-e0ab32209397; detaching it from the instance and deleting it from the info cache
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.network.neutron [req-4b32acfe-9524-4c1e-9a84-d5053770a77c req-f756c0fa-3c63-4d04-b464-c6731a427f27 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:38:32 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Took 1.13 seconds to deallocate network for instance.
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:32 user nova-compute[75239]: WARNING nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state active and task_state rebuilding.
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:32 user nova-compute[75239]: WARNING nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state active and task_state rebuilding.
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-unplugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-unplugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:32 user nova-compute[75239]: WARNING nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-unplugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state active and task_state rebuilding.
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:32 user nova-compute[75239]: WARNING nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state active and task_state rebuilding.
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received event network-vif-unplugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] No waiting events found dispatching network-vif-unplugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received event network-vif-unplugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received event network-vif-plugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Acquiring lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] No waiting events found dispatching network-vif-plugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:32 user nova-compute[75239]: WARNING nova.compute.manager [req-cbbf3e52-1279-47ce-b48c-15be7e620d62 req-0554bb68-510c-4d1f-88d6-80944caa3763 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Received unexpected event network-vif-plugged-d7bfe0e9-fe15-4a8f-b258-e0ab32209397 for instance with vm_state active and task_state deleting.
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-4b32acfe-9524-4c1e-9a84-d5053770a77c req-f756c0fa-3c63-4d04-b464-c6731a427f27 service nova] [instance: ae8531d9-3930-4373-91b2-628d850e8ba7] Detach interface failed, port_id=d7bfe0e9-fe15-4a8f-b258-e0ab32209397, reason: Instance ae8531d9-3930-4373-91b2-628d850e8ba7 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:32 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 1fe94db5-cf69-4e80-a779-e2182588ab56 could not be found.
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzyCURQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:32 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c1d1df-f1c1-4325-86bb-d488fee95ac7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:38:32 user nova-compute[75239]: No targets found.
Nov 13 20:38:32 user nova-compute[75239]: iSNS:
Nov 13 20:38:32 user nova-compute[75239]: No targets found.
Nov 13 20:38:32 user nova-compute[75239]: STATIC:
Nov 13 20:38:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:38:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:38:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:38:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030
Nov 13 20:38:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:38:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a
Nov 13 20:38:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:32 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c
Nov 13 20:38:32 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:32 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:32 user nova-compute[75239]: FIRMWARE:
Nov 13 20:38:32 user nova-compute[75239]: No targets found.
Nov 13 20:38:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:38:32 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:38:32 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dce737-2cf4-4c02-9347-5762dd9264a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee6034a-1977-4b3f-b674-0347f82cfb1a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:32 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605d3640>, {}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Disconnecting from: [] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] <== disconnect_volume: return (89ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:32 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:33 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Error from libvirt while getting description of instance-00000006: [Error Code 42] Domain not found: no domain with matching uuid 'ae8531d9-3930-4373-91b2-628d850e8ba7' (instance-00000006): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ae8531d9-3930-4373-91b2-628d850e8ba7' (instance-00000006)
Nov 13 20:38:33 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid '1fe94db5-cf69-4e80-a779-e2182588ab56' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid '1fe94db5-cf69-4e80-a779-e2182588ab56' (instance-00000010)
Nov 13 20:38:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:33 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 3.533s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] No waiting events found dispatching network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:36 user nova-compute[75239]: WARNING nova.compute.manager [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received unexpected event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] No waiting events found dispatching network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:36 user nova-compute[75239]: WARNING nova.compute.manager [req-b0327e92-06c5-4701-b8eb-0998da8ddb64 req-31af291a-6521-4d87-9aa7-481e3bef860a service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received unexpected event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:38:36 user nova-compute[75239]: INFO nova.compute.manager [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Rescuing
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquired lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:38:36 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:38:36 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7062MB free_disk=24.997745513916016GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:36 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Instance spawned successfully.
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:38:36 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Deleted allocations for instance ae8531d9-3930-4373-91b2-628d850e8ba7
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Preparing to wait for external event volume-reimaged-1faa23e0-a730-43ba-9425-eca3b7105d2f {{(pid=75239) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4154d047-d607-45f9-8c08-ed2bb6c56161 tempest-VolumesAdminNegativeTest-1388057922 tempest-VolumesAdminNegativeTest-1388057922-project-member] Lock "ae8531d9-3930-4373-91b2-628d850e8ba7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.048s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d67fcb6b-fb37-4d04-8dab-d74370f76981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 55f96b7f-454c-440a-9c78-f91305569e87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1fe94db5-cf69-4e80-a779-e2182588ab56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance fcafe860-22f2-4e7f-b1fc-d515c81762bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f867644d-af12-4b8b-be06-ff6c00344095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updating instance_info_cache with network_info: [{"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Releasing lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:36 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f59ce508-2487-4e71-8c09-ffd17dd0eafc is timed out.
Nov 13 20:38:36 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully detached device vdb from instance f59ce508-2487-4e71-8c09-ffd17dd0eafc from the live domain config.
Nov 13 20:38:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jSfhYNrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:36 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:38:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eaf465-90ec-426a-afb1-9cab2a7e9285]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:38:37 user nova-compute[75239]: No targets found.
Nov 13 20:38:37 user nova-compute[75239]: iSNS:
Nov 13 20:38:37 user nova-compute[75239]: No targets found.
Nov 13 20:38:37 user nova-compute[75239]: STATIC:
Nov 13 20:38:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:38:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:38:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:38:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030
Nov 13 20:38:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0
Nov 13 20:38:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a
Nov 13 20:38:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c
Nov 13 20:38:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:38:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:38:37 user nova-compute[75239]: FIRMWARE:
Nov 13 20:38:37 user nova-compute[75239]: No targets found.
Nov 13 20:38:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:38:37 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:38:37 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[269043ea-3c1e-4453-9bfc-dd7bbf65774c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe24198-e94e-44b6-bd89-222fc2db4e7f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:37 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8424d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.741s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.448s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75239) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[229e208e-20d7-4163-a2c6-0493a4f0ba78]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f44063-34b9-4047-b8e5-62fa65b74ee5]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5eb284-81d2-4fb3-9e1f-ad21020f0600]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-8dcac51e-d6bd-4ad5-8ae9-109a052d3e6e req-8441b621-6783-416d-8215-217f1f18d8db service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-unplugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8dcac51e-d6bd-4ad5-8ae9-109a052d3e6e req-8441b621-6783-416d-8215-217f1f18d8db service nova] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8dcac51e-d6bd-4ad5-8ae9-109a052d3e6e req-8441b621-6783-416d-8215-217f1f18d8db service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8dcac51e-d6bd-4ad5-8ae9-109a052d3e6e req-8441b621-6783-416d-8215-217f1f18d8db service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-8dcac51e-d6bd-4ad5-8ae9-109a052d3e6e req-8441b621-6783-416d-8215-217f1f18d8db service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] No waiting events found dispatching network-vif-unplugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:37 user nova-compute[75239]: WARNING nova.compute.manager [req-8dcac51e-d6bd-4ad5-8ae9-109a052d3e6e req-8441b621-6783-416d-8215-217f1f18d8db service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received unexpected event network-vif-unplugged-480fb2da-ad24-40ae-8586-d9050eca6899 for instance with vm_state active and task_state rescuing.
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9b7e84a-b3c1-40d5-8abd-1c7f904ac06c tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.119s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26e11a-7dfa-427f-829e-b8bbe7c57e8a]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6a5cfd-01ed-41d9-aab6-63c2820bf28d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c4d024-8cf7-4da1-8a07-9284acddbd9b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260]
Nov 13 20:38:37 user nova-compute[75239]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0, portal: 172.16.0.220,3260] successful.
Nov 13 20:38:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211604d0-2297-4169-9d9f-1034e5ff23b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[deef4a95-d56c-435b-9061-214bd8b5df0f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== disconnect_volume: return (465ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Instance destroyed successfully.
Nov 13 20:38:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Attempting rescue
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Instance directory exists: not creating {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 20:38:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Creating image(s)
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue" returned: 0 in 0.141s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'migration_context' on Instance uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.base [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<3cbf6e73-bc09-4e1f-b249-261f0534c6e0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Start _get_guest_xml network_info=[{"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "vif_mac": "fa:16:3e:e5:5d:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'resources' on Instance uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.base [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<3cbf6e73-bc09-4e1f-b249-261f0534c6e0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'numa_topology' on Instance uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.base [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<3cbf6e73-bc09-4e1f-b249-261f0534c6e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:38:38 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:38:38 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.base [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<3cbf6e73-bc09-4e1f-b249-261f0534c6e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355998343',display_name='tempest-ServerRescueNegativeTestJSON-server-1355998343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355998343',id=18,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:36:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-rx1jyauh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:54Z,user_data=None,user_id='b27083a4000d4ba2832a394b9140b530',uuid=3cbf6e73-bc09-4e1f-b249-261f0534c6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "vif_mac": "fa:16:3e:e5:5d:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "vif_mac": "fa:16:3e:e5:5d:ad"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:5d:ad,bridge_name='br-int',has_traffic_filtering=True,id=480fb2da-ad24-40ae-8586-d9050eca6899,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480fb2da-ad') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.instance [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.objects.base [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<3cbf6e73-bc09-4e1f-b249-261f0534c6e0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:38:38 user nova-compute[75239]:   <uuid>3cbf6e73-bc09-4e1f-b249-261f0534c6e0</uuid>
Nov 13 20:38:38 user nova-compute[75239]:   <name>instance-00000012</name>
Nov 13 20:38:38 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:38:38 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:38:38 user nova-compute[75239]:   <metadata>
Nov 13 20:38:38 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:38:38 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:38:38 user nova-compute[75239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1355998343</nova:name>
Nov 13 20:38:38 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:38:38</nova:creationTime>
Nov 13 20:38:38 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:38:38 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:38:38 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:38:38 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:38:38 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:38:38 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:38:38 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:38:38 user nova-compute[75239]:       <nova:owner>
Nov 13 20:38:38 user nova-compute[75239]:         <nova:user uuid="b27083a4000d4ba2832a394b9140b530">tempest-ServerRescueNegativeTestJSON-1212200086-project-member</nova:user>
Nov 13 20:38:38 user nova-compute[75239]:         <nova:project uuid="41532512e3494bfd9051c340c2557bfe">tempest-ServerRescueNegativeTestJSON-1212200086</nova:project>
Nov 13 20:38:38 user nova-compute[75239]:       </nova:owner>
Nov 13 20:38:38 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:38:38 user nova-compute[75239]:       <nova:ports>
Nov 13 20:38:38 user nova-compute[75239]:         <nova:port uuid="480fb2da-ad24-40ae-8586-d9050eca6899">
Nov 13 20:38:38 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 20:38:38 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:38 user nova-compute[75239]:       </nova:ports>
Nov 13 20:38:38 user nova-compute[75239]:     </nova:instance>
Nov 13 20:38:38 user nova-compute[75239]:   </metadata>
Nov 13 20:38:38 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:38:38 user nova-compute[75239]:     <system>
Nov 13 20:38:38 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:38:38 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:38:38 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:38:38 user nova-compute[75239]:       <entry name="serial">3cbf6e73-bc09-4e1f-b249-261f0534c6e0</entry>
Nov 13 20:38:38 user nova-compute[75239]:       <entry name="uuid">3cbf6e73-bc09-4e1f-b249-261f0534c6e0</entry>
Nov 13 20:38:38 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:38:38 user nova-compute[75239]:     </system>
Nov 13 20:38:38 user nova-compute[75239]:   </sysinfo>
Nov 13 20:38:38 user nova-compute[75239]:   <os>
Nov 13 20:38:38 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:38:38 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:38:38 user nova-compute[75239]:   </os>
Nov 13 20:38:38 user nova-compute[75239]:   <features>
Nov 13 20:38:38 user nova-compute[75239]:     <acpi/>
Nov 13 20:38:38 user nova-compute[75239]:     <apic/>
Nov 13 20:38:38 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:38:38 user nova-compute[75239]:   </features>
Nov 13 20:38:38 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:38:38 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:38:38 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:38:38 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:38:38 user nova-compute[75239]:   </clock>
Nov 13 20:38:38 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:38:38 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:38:38 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:38:38 user nova-compute[75239]:   </cpu>
Nov 13 20:38:38 user nova-compute[75239]:   <devices>
Nov 13 20:38:38 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:38:38 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:38:38 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue"/>
Nov 13 20:38:38 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:38:38 user nova-compute[75239]:     </disk>
Nov 13 20:38:38 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:38:38 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:38:38 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk"/>
Nov 13 20:38:38 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:38:38 user nova-compute[75239]:     </disk>
Nov 13 20:38:38 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:38 user nova-compute[75239]:       <mac address="fa:16:3e:e5:5d:ad"/>
Nov 13 20:38:38 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:38 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:38 user nova-compute[75239]:       <target dev="tap480fb2da-ad"/>
Nov 13 20:38:38 user nova-compute[75239]:     </interface>
Nov 13 20:38:38 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:38:38 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/console.log" append="off"/>
Nov 13 20:38:38 user nova-compute[75239]:     </serial>
Nov 13 20:38:38 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:38:38 user nova-compute[75239]:     <video>
Nov 13 20:38:38 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:38 user nova-compute[75239]:     </video>
Nov 13 20:38:38 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:38:38 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:38:38 user nova-compute[75239]:     </rng>
Nov 13 20:38:38 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:38:38 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:38:38 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:38:38 user nova-compute[75239]:     </memballoon>
Nov 13 20:38:38 user nova-compute[75239]:   </devices>
Nov 13 20:38:38 user nova-compute[75239]: </domain>
Nov 13 20:38:38 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:38:38 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Instance destroyed successfully.
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-dae69b0a-cee6-447d-b852-f85449eda670 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.969s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No VIF found with MAC fa:16:3e:e5:5d:ad, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8e40dd7d-8a77-4baf-8137-83713dd6a05e tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8e40dd7d-8a77-4baf-8137-83713dd6a05e tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8e40dd7d-8a77-4baf-8137-83713dd6a05e tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8e40dd7d-8a77-4baf-8137-83713dd6a05e tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75239) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8e40dd7d-8a77-4baf-8137-83713dd6a05e tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-5a547539-724d-4cb0-9029-7308d0ee6692 req-cd1fc900-e8de-492e-80ab-064ad88c2e07 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5a547539-724d-4cb0-9029-7308d0ee6692 req-cd1fc900-e8de-492e-80ab-064ad88c2e07 service nova] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5a547539-724d-4cb0-9029-7308d0ee6692 req-cd1fc900-e8de-492e-80ab-064ad88c2e07 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5a547539-724d-4cb0-9029-7308d0ee6692 req-cd1fc900-e8de-492e-80ab-064ad88c2e07 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-5a547539-724d-4cb0-9029-7308d0ee6692 req-cd1fc900-e8de-492e-80ab-064ad88c2e07 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] No waiting events found dispatching network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:39 user nova-compute[75239]: WARNING nova.compute.manager [req-5a547539-724d-4cb0-9029-7308d0ee6692 req-cd1fc900-e8de-492e-80ab-064ad88c2e07 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received unexpected event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 for instance with vm_state active and task_state rescuing.
Nov 13 20:38:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance destroyed successfully.
Nov 13 20:38:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8e40dd7d-8a77-4baf-8137-83713dd6a05e tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8e40dd7d-8a77-4baf-8137-83713dd6a05e tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.018s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:41 user nova-compute[75239]: WARNING nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state None.
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:41 user nova-compute[75239]: WARNING nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state None.
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:41 user nova-compute[75239]: WARNING nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state None.
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:41 user nova-compute[75239]: WARNING nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state None.
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:41 user nova-compute[75239]: WARNING nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state None.
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:41 user nova-compute[75239]: WARNING nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state None.
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] No waiting events found dispatching network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:41 user nova-compute[75239]: WARNING nova.compute.manager [req-0a08f840-b667-40a0-93e0-975f7c80a8cf req-8514c109-df0b-445e-a70e-87ebc39b2e44 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received unexpected event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 for instance with vm_state active and task_state rescuing.
Nov 13 20:38:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b5fda83c-f601-4205-9663-cf6dde90728a tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:38:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-e694fdcb-a10a-495c-8d77-f0be86dea413 req-904031d4-04f0-4123-b93c-2ada3166b3ae service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e694fdcb-a10a-495c-8d77-f0be86dea413 req-904031d4-04f0-4123-b93c-2ada3166b3ae service nova] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e694fdcb-a10a-495c-8d77-f0be86dea413 req-904031d4-04f0-4123-b93c-2ada3166b3ae service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e694fdcb-a10a-495c-8d77-f0be86dea413 req-904031d4-04f0-4123-b93c-2ada3166b3ae service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-e694fdcb-a10a-495c-8d77-f0be86dea413 req-904031d4-04f0-4123-b93c-2ada3166b3ae service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] No waiting events found dispatching network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:43 user nova-compute[75239]: WARNING nova.compute.manager [req-e694fdcb-a10a-495c-8d77-f0be86dea413 req-904031d4-04f0-4123-b93c-2ada3166b3ae service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received unexpected event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 for instance with vm_state rescued and task_state None.
Nov 13 20:38:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-614beddb-f690-4d3c-9daf-0f6abb72acbd req-0d8f9505-d3b7-44ea-9f38-351931679dac service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event volume-reimaged-1faa23e0-a730-43ba-9425-eca3b7105d2f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-614beddb-f690-4d3c-9daf-0f6abb72acbd req-0d8f9505-d3b7-44ea-9f38-351931679dac service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-614beddb-f690-4d3c-9daf-0f6abb72acbd req-0d8f9505-d3b7-44ea-9f38-351931679dac service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-614beddb-f690-4d3c-9daf-0f6abb72acbd req-0d8f9505-d3b7-44ea-9f38-351931679dac service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-614beddb-f690-4d3c-9daf-0f6abb72acbd req-0d8f9505-d3b7-44ea-9f38-351931679dac service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Processing event volume-reimaged-1faa23e0-a730-43ba-9425-eca3b7105d2f {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 13 20:38:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:38:50 user nova-compute[75239]: INFO nova.virt.block_device [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Booting with volume 1faa23e0-a730-43ba-9425-eca3b7105d2f at /dev/vda
Nov 13 20:38:51 user nova-compute[75239]: DEBUG os_brick.utils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be85efa9-e9e6-4504-99a4-92d06d417795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[851b0796-dc26-42d2-869b-931a78daaa71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec05632-4c67-4315-8d6f-c239de744f50]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9e45db-ea3e-408e-8170-a1b8bfc1e626]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:38:51 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:38:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[48840e6d-5b58-4559-b3c8-28b3ab8a6dc8]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG os_brick.utils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Updating existing volume attachment record: 2cd7e756-f860-4aac-8af9-b6b652b9b33e {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:38:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:38:55 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Creating image(s)
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Ensure instance console log exists: /opt/stack/data/nova/instances/1fe94db5-cf69-4e80-a779-e2182588ab56/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Start _get_guest_xml network_info=[{"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2cd7e756-f860-4aac-8af9-b6b652b9b33e', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzyCURQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fe94db5-cf69-4e80-a779-e2182588ab56', 'attached_at': '', 'detached_at': '', 'volume_id': '1faa23e0-a730-43ba-9425-eca3b7105d2f', 'serial': '1faa23e0-a730-43ba-9425-eca3b7105d2f'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:38:55 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 20:38:55 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.objects.instance [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1fe94db5-cf69-4e80-a779-e2182588ab56 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzyCURQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:38:55 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 20:38:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:55 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 20:38:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:38:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:38:55 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:38:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a5b782-13ec-4444-ae7f-ef7362c1d243]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:38:56 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b2e416-9f4b-464d-b53a-68cbb6004045]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f] added
Nov 13 20:38:56 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[16366f6f-7b50-418a-99bf-068bc9c9930b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b142ce-00ec-414f-bbc0-169094894887]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzyCURQb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EzyCURQb" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc17f259-c961-4db4-bcac-4502b84a9ab6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EzyCURQb'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8f546e-46fe-4691-803b-8d8fa6282ed9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2098f2f-5dea-4f6e-add8-4d8ad8c42d76]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:56 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:56 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e220ea9e-ec97-4382-b501-a954a595a948]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260]
Nov 13 20:38:56 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260] successful.
Nov 13 20:38:56 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b7ef0b-5d4a-4064-ae43-4228bd93bddf]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edfaa50-5915-4831-819a-9eb7fb199668]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:56 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:38:56 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:38:56 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcf4484-278b-41d6-9a9e-e371b0e0f605]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzyCURQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:38:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23339353933396131', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339353933396131', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-364989443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-80459434',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4bTkMByBBN86gQLJ0njqwBvWR0XDRjrFeM5rsfRs/jEsAUVgdGRCe/qEZj7jheAmcMs60nSNIENVVJ15Le3mNrjiOZ1ooTGgvR6HWSRyk2+0hsYobO++zcjvL8uksDpg==',key_name='tempest-keypair-1832288825',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:36:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='100038f3462149338c8baaefb89970e5',ramdisk_id='',reservation_id='r-cyw07hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-403999266',owner_user_name='tempest-ServerActionsV293TestJSON-403999266-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0adecc32b22a4d7a910320d9f6c4f2ee',uuid=1fe94db5-cf69-4e80-a779-e2182588ab56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converting VIF {"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:38:57 user nova-compute[75239]:   <uuid>1fe94db5-cf69-4e80-a779-e2182588ab56</uuid>
Nov 13 20:38:57 user nova-compute[75239]:   <name>instance-00000010</name>
Nov 13 20:38:57 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:38:57 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:38:57 user nova-compute[75239]:   <metadata>
Nov 13 20:38:57 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:38:57 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:38:57 user nova-compute[75239]:       <nova:name>tempest-ServerActionsV293TestJSON-server-364989443</nova:name>
Nov 13 20:38:57 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:38:55</nova:creationTime>
Nov 13 20:38:57 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:38:57 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:38:57 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:38:57 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:38:57 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:38:57 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:38:57 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:38:57 user nova-compute[75239]:       <nova:owner>
Nov 13 20:38:57 user nova-compute[75239]:         <nova:user uuid="0adecc32b22a4d7a910320d9f6c4f2ee">tempest-ServerActionsV293TestJSON-403999266-project-member</nova:user>
Nov 13 20:38:57 user nova-compute[75239]:         <nova:project uuid="100038f3462149338c8baaefb89970e5">tempest-ServerActionsV293TestJSON-403999266</nova:project>
Nov 13 20:38:57 user nova-compute[75239]:       </nova:owner>
Nov 13 20:38:57 user nova-compute[75239]:       <nova:ports>
Nov 13 20:38:57 user nova-compute[75239]:         <nova:port uuid="37dadfef-e9b8-45fe-a9f2-901e412a21d0">
Nov 13 20:38:57 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 20:38:57 user nova-compute[75239]:         </nova:port>
Nov 13 20:38:57 user nova-compute[75239]:       </nova:ports>
Nov 13 20:38:57 user nova-compute[75239]:     </nova:instance>
Nov 13 20:38:57 user nova-compute[75239]:   </metadata>
Nov 13 20:38:57 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:38:57 user nova-compute[75239]:     <system>
Nov 13 20:38:57 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:38:57 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:38:57 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:38:57 user nova-compute[75239]:       <entry name="serial">1fe94db5-cf69-4e80-a779-e2182588ab56</entry>
Nov 13 20:38:57 user nova-compute[75239]:       <entry name="uuid">1fe94db5-cf69-4e80-a779-e2182588ab56</entry>
Nov 13 20:38:57 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:38:57 user nova-compute[75239]:     </system>
Nov 13 20:38:57 user nova-compute[75239]:   </sysinfo>
Nov 13 20:38:57 user nova-compute[75239]:   <os>
Nov 13 20:38:57 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:38:57 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:38:57 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:38:57 user nova-compute[75239]:   </os>
Nov 13 20:38:57 user nova-compute[75239]:   <features>
Nov 13 20:38:57 user nova-compute[75239]:     <acpi/>
Nov 13 20:38:57 user nova-compute[75239]:     <apic/>
Nov 13 20:38:57 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:38:57 user nova-compute[75239]:   </features>
Nov 13 20:38:57 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:38:57 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:38:57 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:38:57 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:38:57 user nova-compute[75239]:   </clock>
Nov 13 20:38:57 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:38:57 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:38:57 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:38:57 user nova-compute[75239]:   </cpu>
Nov 13 20:38:57 user nova-compute[75239]:   <devices>
Nov 13 20:38:57 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:38:57 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:57 user nova-compute[75239]:       <source dev="/dev/sdc"/>
Nov 13 20:38:57 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:38:57 user nova-compute[75239]:       <serial>1faa23e0-a730-43ba-9425-eca3b7105d2f</serial>
Nov 13 20:38:57 user nova-compute[75239]:     </disk>
Nov 13 20:38:57 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:38:57 user nova-compute[75239]:       <mac address="fa:16:3e:a4:19:fe"/>
Nov 13 20:38:57 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:57 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:38:57 user nova-compute[75239]:       <target dev="tap37dadfef-e9"/>
Nov 13 20:38:57 user nova-compute[75239]:     </interface>
Nov 13 20:38:57 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:38:57 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/1fe94db5-cf69-4e80-a779-e2182588ab56/console.log" append="off"/>
Nov 13 20:38:57 user nova-compute[75239]:     </serial>
Nov 13 20:38:57 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:38:57 user nova-compute[75239]:     <video>
Nov 13 20:38:57 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:38:57 user nova-compute[75239]:     </video>
Nov 13 20:38:57 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:38:57 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:38:57 user nova-compute[75239]:     </rng>
Nov 13 20:38:57 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:38:57 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:38:57 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:38:57 user nova-compute[75239]:     </memballoon>
Nov 13 20:38:57 user nova-compute[75239]:   </devices>
Nov 13 20:38:57 user nova-compute[75239]: </domain>
Nov 13 20:38:57 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-364989443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-80459434',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4bTkMByBBN86gQLJ0njqwBvWR0XDRjrFeM5rsfRs/jEsAUVgdGRCe/qEZj7jheAmcMs60nSNIENVVJ15Le3mNrjiOZ1ooTGgvR6HWSRyk2+0hsYobO++zcjvL8uksDpg==',key_name='tempest-keypair-1832288825',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:36:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='100038f3462149338c8baaefb89970e5',ramdisk_id='',reservation_id='r-cyw07hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-403999266',owner_user_name='tempest-ServerActionsV293TestJSON-403999266-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:38:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0adecc32b22a4d7a910320d9f6c4f2ee',uuid=1fe94db5-cf69-4e80-a779-e2182588ab56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converting VIF {"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG os_vif [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27684dbd-0606-5f9e-a15c-4894f84f2cbd', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37dadfef-e9, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37dadfef-e9, col_values=(('qos', UUID('048dcf23-b3f6-47c2-93fc-cdb287b7fe59')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37dadfef-e9, col_values=(('external_ids', {'iface-id': '37dadfef-e9b8-45fe-a9f2-901e412a21d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:19:fe', 'vm-uuid': '1fe94db5-cf69-4e80-a779-e2182588ab56'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:57 user nova-compute[75239]: INFO os_vif [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9')
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] No VIF found with MAC fa:16:3e:a4:19:fe, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:58 user nova-compute[75239]: INFO nova.compute.manager [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Detaching volume 00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a
Nov 13 20:38:58 user nova-compute[75239]: INFO nova.virt.block_device [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Attempting to driver detach volume 00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a from mountpoint /dev/vdb
Nov 13 20:38:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Attempting to detach device vdb from instance d67fcb6b-fb37-4d04-8dab-d74370f76981 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:38:58 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:58 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:38:58 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:38:58 user nova-compute[75239]:   <serial>00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a</serial>
Nov 13 20:38:58 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:38:58 user nova-compute[75239]: </disk>
Nov 13 20:38:58 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:38:58 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Successfully detached device vdb from instance d67fcb6b-fb37-4d04-8dab-d74370f76981 from the persistent domain config.
Nov 13 20:38:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d67fcb6b-fb37-4d04-8dab-d74370f76981 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:38:58 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:38:58 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:38:58 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:38:58 user nova-compute[75239]:   <serial>00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a</serial>
Nov 13 20:38:58 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:38:58 user nova-compute[75239]: </disk>
Nov 13 20:38:58 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-5d6f45c6-df2f-4343-811b-d7b436b35b72 req-67b4dc72-b3f9-4a29-9a94-87bfa2773f56 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5d6f45c6-df2f-4343-811b-d7b436b35b72 req-67b4dc72-b3f9-4a29-9a94-87bfa2773f56 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5d6f45c6-df2f-4343-811b-d7b436b35b72 req-67b4dc72-b3f9-4a29-9a94-87bfa2773f56 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5d6f45c6-df2f-4343-811b-d7b436b35b72 req-67b4dc72-b3f9-4a29-9a94-87bfa2773f56 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-5d6f45c6-df2f-4343-811b-d7b436b35b72 req-67b4dc72-b3f9-4a29-9a94-87bfa2773f56 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:38:58 user nova-compute[75239]: WARNING nova.compute.manager [req-5d6f45c6-df2f-4343-811b-d7b436b35b72 req-67b4dc72-b3f9-4a29-9a94-87bfa2773f56 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 20:38:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 36c1f1d7-f3f9-4d41-b116-babf44d80f34 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid d816fbc5-c148-472b-9ade-c0175ccb38e0 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 1ec27628-db61-49c0-951b-6e72ac2f4f15 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid f867644d-af12-4b8b-be06-ff6c00344095 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 55f96b7f-454c-440a-9c78-f91305569e87 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 1fe94db5-cf69-4e80-a779-e2182588ab56 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "f867644d-af12-4b8b-be06-ff6c00344095" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "55f96b7f-454c-440a-9c78-f91305569e87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:38:59 user nova-compute[75239]: INFO nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "f867644d-af12-4b8b-be06-ff6c00344095" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "55f96b7f-454c-440a-9c78-f91305569e87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.144s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:38:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:00 user nova-compute[75239]: DEBUG nova.compute.manager [req-f3ed6266-13ec-493b-815c-845a3f698e92 req-4e32f269-2d80-46bb-8174-570ef2dcec1c service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f3ed6266-13ec-493b-815c-845a3f698e92 req-4e32f269-2d80-46bb-8174-570ef2dcec1c service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f3ed6266-13ec-493b-815c-845a3f698e92 req-4e32f269-2d80-46bb-8174-570ef2dcec1c service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f3ed6266-13ec-493b-815c-845a3f698e92 req-4e32f269-2d80-46bb-8174-570ef2dcec1c service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:00 user nova-compute[75239]: DEBUG nova.compute.manager [req-f3ed6266-13ec-493b-815c-845a3f698e92 req-4e32f269-2d80-46bb-8174-570ef2dcec1c service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:00 user nova-compute[75239]: WARNING nova.compute.manager [req-f3ed6266-13ec-493b-815c-845a3f698e92 req-4e32f269-2d80-46bb-8174-570ef2dcec1c service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:39:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance spawned successfully.
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG nova.objects.instance [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75239) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 20:39:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-614beddb-f690-4d3c-9daf-0f6abb72acbd tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.096s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-0bf08e63-6afb-4b30-91a8-bdd4820cb6b9 req-adc121eb-c921-449a-88de-5c54f23d4feb service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received event network-changed-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-0bf08e63-6afb-4b30-91a8-bdd4820cb6b9 req-adc121eb-c921-449a-88de-5c54f23d4feb service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Refreshing instance network info cache due to event network-changed-3a120adc-128c-4dba-aab5-c23fd9ee017d. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:39:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0bf08e63-6afb-4b30-91a8-bdd4820cb6b9 req-adc121eb-c921-449a-88de-5c54f23d4feb service nova] Acquiring lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0bf08e63-6afb-4b30-91a8-bdd4820cb6b9 req-adc121eb-c921-449a-88de-5c54f23d4feb service nova] Acquired lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:11 user nova-compute[75239]: DEBUG nova.network.neutron [req-0bf08e63-6afb-4b30-91a8-bdd4820cb6b9 req-adc121eb-c921-449a-88de-5c54f23d4feb service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Refreshing network info cache for port 3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG nova.network.neutron [req-0bf08e63-6afb-4b30-91a8-bdd4820cb6b9 req-adc121eb-c921-449a-88de-5c54f23d4feb service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Updated VIF entry in instance network info cache for port 3a120adc-128c-4dba-aab5-c23fd9ee017d. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG nova.network.neutron [req-0bf08e63-6afb-4b30-91a8-bdd4820cb6b9 req-adc121eb-c921-449a-88de-5c54f23d4feb service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Updating instance_info_cache with network_info: [{"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0bf08e63-6afb-4b30-91a8-bdd4820cb6b9 req-adc121eb-c921-449a-88de-5c54f23d4feb service nova] Releasing lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG nova.objects.instance [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'flavor' on Instance uuid 1ec27628-db61-49c0-951b-6e72ac2f4f15 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:12 user nova-compute[75239]: INFO nova.compute.manager [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Attaching volume 81e3bc74-88d2-4032-b831-909172ab11f6 to /dev/vdb
Nov 13 20:39:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG os_brick.utils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9102abe2-0314-44f6-91db-528e4fed686a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32da758-2b07-4785-983a-bf857505206d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8007a026-1b88-4028-b665-755077317f91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc445cd-106d-4b9e-bcab-5c12b5ac952e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:39:12 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:39:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[693da521-4077-48a5-a4de-a5060ae85505]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG os_brick.utils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:12 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Updating existing volume attachment record: 0f18610e-100e-463a-bd96-2b9d8fc80cdd {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:39:16 user nova-compute[75239]: INFO nova.compute.manager [None req-cf7ad975-7398-4a80-9f97-91319863cff9 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Unrescuing
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-cf7ad975-7398-4a80-9f97-91319863cff9 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-cf7ad975-7398-4a80-9f97-91319863cff9 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquired lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG nova.network.neutron [None req-cf7ad975-7398-4a80-9f97-91319863cff9 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFPSBHUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:16 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:16 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:16 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefa8826-69a3-4090-be36-65f0602251b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:39:16 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d8edc8-361e-4635-bbbc-7175b9c90723]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6] added
Nov 13 20:39:16 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e310dc-20f1-4d3a-af95-c496f40b18c5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32a7508-b302-4a22-ba34-cb2ecda7fa33]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFPSBHUa {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VFPSBHUa" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[618c0f97-3497-4bd9-a8ad-0f1d839dbe3e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VFPSBHUa'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d493dce-6f34-4b9b-96b2-e22b1567a464]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG nova.network.neutron [None req-cf7ad975-7398-4a80-9f97-91319863cff9 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updating instance_info_cache with network_info: [{"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-cf7ad975-7398-4a80-9f97-91319863cff9 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Releasing lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG nova.objects.instance [None req-cf7ad975-7398-4a80-9f97-91319863cff9 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'flavor' on Instance uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d14f92-83da-4c51-b64e-c56bec9711cd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a33a4f-d34e-4bef-8eaa-e5c9fd1bac74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6, portal: 172.16.0.220,3260]
Nov 13 20:39:17 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6, portal: 172.16.0.220,3260] successful.
Nov 13 20:39:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d11b68-1576-40d7-a202-bb34c2aba7b3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8208acea-5c4f-4469-85b8-cbf08356c5c1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:17 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0171777-31e5-45b2-8fb1-4971d0d79e18]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFPSBHUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-bad38a52-b5c4-4f25-a327-dc151b399d61 req-b717e8f8-0627-4614-989e-c8e5209d0bf4 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-unplugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bad38a52-b5c4-4f25-a327-dc151b399d61 req-b717e8f8-0627-4614-989e-c8e5209d0bf4 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bad38a52-b5c4-4f25-a327-dc151b399d61 req-b717e8f8-0627-4614-989e-c8e5209d0bf4 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bad38a52-b5c4-4f25-a327-dc151b399d61 req-b717e8f8-0627-4614-989e-c8e5209d0bf4 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-bad38a52-b5c4-4f25-a327-dc151b399d61 req-b717e8f8-0627-4614-989e-c8e5209d0bf4 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-unplugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:17 user nova-compute[75239]: WARNING nova.compute.manager [req-bad38a52-b5c4-4f25-a327-dc151b399d61 req-b717e8f8-0627-4614-989e-c8e5209d0bf4 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-unplugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:39:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:17 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance destroyed successfully.
Nov 13 20:39:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23366636535346436', 'path': '/dev/sde'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366636535346436', 'path': '/dev/sde'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG nova.objects.instance [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'flavor' on Instance uuid 1ec27628-db61-49c0-951b-6e72ac2f4f15 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:39:18 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:39:18 user nova-compute[75239]:   <source dev="/dev/sde"/>
Nov 13 20:39:18 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:39:18 user nova-compute[75239]:   <serial>81e3bc74-88d2-4032-b831-909172ab11f6</serial>
Nov 13 20:39:18 user nova-compute[75239]: </disk>
Nov 13 20:39:18 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No VIF found with MAC fa:16:3e:b8:03:ba, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-51ed2ee6-ac28-4c7c-a6bc-6ee22c565a15 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.573s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:18 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d67fcb6b-fb37-4d04-8dab-d74370f76981 is timed out.
Nov 13 20:39:18 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Successfully detached device vdb from instance d67fcb6b-fb37-4d04-8dab-d74370f76981 from the live domain config.
Nov 13 20:39:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VYrbHCzx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c476b3ea-d3ed-40d8-aa9f-3043303c58c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:39:19 user nova-compute[75239]: No targets found.
Nov 13 20:39:19 user nova-compute[75239]: iSNS:
Nov 13 20:39:19 user nova-compute[75239]: No targets found.
Nov 13 20:39:19 user nova-compute[75239]: STATIC:
Nov 13 20:39:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:39:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:39:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:39:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6
Nov 13 20:39:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030
Nov 13 20:39:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a
Nov 13 20:39:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:39:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c
Nov 13 20:39:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:19 user nova-compute[75239]: FIRMWARE:
Nov 13 20:39:19 user nova-compute[75239]: No targets found.
Nov 13 20:39:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:39:19 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:39:19 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[87966b07-f353-4837-ba27-60dceb887a3c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5646b10b-eb1f-4a4b-8bc6-a99e8caa3656]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:19 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8411d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a'): ({'sdd'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Removing single pathed devices sdd {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd82447-a261-4fc1-9404-c555ab8f6bd2]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9d3b1e-c030-4b9b-a4a5-1aa6311fefa1]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Flushing IO for device /dev/sdd {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[75556da8-7862-45c6-a317-a21d06244cf9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8533125-fa63-434b-9e06-6d3acc9642fb]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f74eb2-8a63-4dc8-86fd-a18068919cf4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0205939c-aada-4940-a076-9af4bf998915]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a, portal: 172.16.0.220,3260]
Nov 13 20:39:19 user nova-compute[75239]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a, portal: 172.16.0.220,3260] successful.
Nov 13 20:39:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00e19ceb-fa3e-4190-89b1-ff2aea5cfd1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa64bf9-aa6b-475d-b4d9-220be22a6adb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] <== disconnect_volume: return (357ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-9e2d58b9-f6c6-469d-98be-a5d5e2e1a5b5 req-86b32668-d102-47b0-9625-8d07da6bb079 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9e2d58b9-f6c6-469d-98be-a5d5e2e1a5b5 req-86b32668-d102-47b0-9625-8d07da6bb079 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9e2d58b9-f6c6-469d-98be-a5d5e2e1a5b5 req-86b32668-d102-47b0-9625-8d07da6bb079 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9e2d58b9-f6c6-469d-98be-a5d5e2e1a5b5 req-86b32668-d102-47b0-9625-8d07da6bb079 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-9e2d58b9-f6c6-469d-98be-a5d5e2e1a5b5 req-86b32668-d102-47b0-9625-8d07da6bb079 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:19 user nova-compute[75239]: WARNING nova.compute.manager [req-9e2d58b9-f6c6-469d-98be-a5d5e2e1a5b5 req-86b32668-d102-47b0-9625-8d07da6bb079 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:39:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:20 user nova-compute[75239]: DEBUG nova.objects.instance [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'flavor' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-70f32813-ec88-4024-a587-2ccd940bfbf8 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.843s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:22 user nova-compute[75239]: WARNING nova.compute.manager [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:22 user nova-compute[75239]: WARNING nova.compute.manager [req-8ecd8a29-d79e-4942-9292-ea6b0fd02c1d req-3ab5ec12-32b6-439e-b565-0ea60c8ab714 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.compute.manager [None req-cf7ad975-7398-4a80-9f97-91319863cff9 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:22 user nova-compute[75239]: INFO nova.compute.manager [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Detaching volume 81e3bc74-88d2-4032-b831-909172ab11f6
Nov 13 20:39:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:22 user nova-compute[75239]: INFO nova.virt.block_device [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Attempting to driver detach volume 81e3bc74-88d2-4032-b831-909172ab11f6 from mountpoint /dev/vdb
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Attempting to detach device vdb from instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:39:22 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:39:22 user nova-compute[75239]:   <source dev="/dev/sde"/>
Nov 13 20:39:22 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:39:22 user nova-compute[75239]:   <serial>81e3bc74-88d2-4032-b831-909172ab11f6</serial>
Nov 13 20:39:22 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:39:22 user nova-compute[75239]: </disk>
Nov 13 20:39:22 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Successfully detached device vdb from instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 from the persistent domain config.
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:39:22 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:39:22 user nova-compute[75239]:   <source dev="/dev/sde"/>
Nov 13 20:39:22 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:39:22 user nova-compute[75239]:   <serial>81e3bc74-88d2-4032-b831-909172ab11f6</serial>
Nov 13 20:39:22 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:39:22 user nova-compute[75239]: </disk>
Nov 13 20:39:22 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:39:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:23 user nova-compute[75239]: INFO nova.compute.manager [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Unshelving
Nov 13 20:39:23 user nova-compute[75239]: INFO nova.virt.block_device [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Booting with volume 60d6ec51-4db8-41b9-ad00-2637e6d888dc at /dev/vdc
Nov 13 20:39:23 user nova-compute[75239]: DEBUG os_brick.utils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f04c27f-f0cb-4f16-925f-c6256316479c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dd8aeb-f3e7-4008-92f7-f8faecdac39f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fae096-52d5-489d-9a54-8d7d045d3e4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd96b41-d01a-4eae-8f89-aae7c061c916]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:39:23 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:39:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9774ab52-6a99-4a7b-b09a-60f319ba8916]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG os_brick.utils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:23 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updating existing volume attachment record: b13f3b32-78f8-47b3-8791-095078d30990 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:39:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-49eb85f5-5008-48e5-a747-ab126c7a8757 req-341d201f-351e-433f-9c58-ff9ac55d1ebc service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-changed-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-49eb85f5-5008-48e5-a747-ab126c7a8757 req-341d201f-351e-433f-9c58-ff9ac55d1ebc service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Refreshing instance network info cache due to event network-changed-a8636abe-8a8c-471f-add4-dbec8745a4a4. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:39:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-49eb85f5-5008-48e5-a747-ab126c7a8757 req-341d201f-351e-433f-9c58-ff9ac55d1ebc service nova] Acquiring lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-49eb85f5-5008-48e5-a747-ab126c7a8757 req-341d201f-351e-433f-9c58-ff9ac55d1ebc service nova] Acquired lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:25 user nova-compute[75239]: DEBUG nova.network.neutron [req-49eb85f5-5008-48e5-a747-ab126c7a8757 req-341d201f-351e-433f-9c58-ff9ac55d1ebc service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Refreshing network info cache for port a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG nova.network.neutron [req-49eb85f5-5008-48e5-a747-ab126c7a8757 req-341d201f-351e-433f-9c58-ff9ac55d1ebc service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updated VIF entry in instance network info cache for port a8636abe-8a8c-471f-add4-dbec8745a4a4. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG nova.network.neutron [req-49eb85f5-5008-48e5-a747-ab126c7a8757 req-341d201f-351e-433f-9c58-ff9ac55d1ebc service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updating instance_info_cache with network_info: [{"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "interface-fcafe860-22f2-4e7f-b1fc-d515c81762bc-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "interface-fcafe860-22f2-4e7f-b1fc-d515c81762bc-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG nova.objects.instance [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lazy-loading 'flavor' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-49eb85f5-5008-48e5-a747-ab126c7a8757 req-341d201f-351e-433f-9c58-ff9ac55d1ebc service nova] Releasing lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG nova.objects.instance [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lazy-loading 'pci_requests' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG nova.objects.base [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Object Instance<fcafe860-22f2-4e7f-b1fc-d515c81762bc> lazy-loaded attributes: flavor,pci_requests {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG nova.network.neutron [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:39:26 user nova-compute[75239]: DEBUG nova.policy [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '276cb9cf493a47a0a8a4ea045e3277c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fffa6e76e666484b8d3d4b66d58c1898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG nova.network.neutron [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Successfully created port: 739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'pci_requests' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'numa_topology' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:39:27 user nova-compute[75239]: INFO nova.compute.claims [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Claim successful on node user
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:39:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Successfully updated port: 739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquired lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-369a0262-31ad-471a-bf62-e878ef4c85a6 req-7331bb2e-a7a5-4cff-93fe-68624db24fcb service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-changed-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-369a0262-31ad-471a-bf62-e878ef4c85a6 req-7331bb2e-a7a5-4cff-93fe-68624db24fcb service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Refreshing instance network info cache due to event network-changed-739b2b46-cd07-45c8-bca5-5d36c8c744b1. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-369a0262-31ad-471a-bf62-e878ef4c85a6 req-7331bb2e-a7a5-4cff-93fe-68624db24fcb service nova] Acquiring lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.705s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:28 user nova-compute[75239]: INFO nova.network.neutron [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updating port 70460a6e-b85a-4875-94c8-fa1917a78871 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.network.neutron [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updating instance_info_cache with network_info: [{"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Releasing lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-369a0262-31ad-471a-bf62-e878ef4c85a6 req-7331bb2e-a7a5-4cff-93fe-68624db24fcb service nova] Acquired lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.network.neutron [req-369a0262-31ad-471a-bf62-e878ef4c85a6 req-7331bb2e-a7a5-4cff-93fe-68624db24fcb service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Refreshing network info cache for port 739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328986222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328986222',id=20,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzePX1hT2woml8vSrOF8vsehzyoQyDIDpKzXNnSV7g611OdghErTyj7yzdlaSTAX9UCgl8tKvGNN0b/Ma50TAXHkeoKbz087TbCFE625mSyZ4RbQrLqedGEnT1H3VPyVA==',key_name='tempest-keypair-989254085',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fffa6e76e666484b8d3d4b66d58c1898',ramdisk_id='',reservation_id='r-fektjpro',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2035153286',owner_user_name='tempest-TaggedAttachmentsTest-2035153286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276cb9cf493a47a0a8a4ea045e3277c4',uuid=fcafe860-22f2-4e7f-b1fc-d515c81762bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converting VIF {"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG os_vif [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8880a376-2de0-54cd-a8a1-16478b6690c6', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap739b2b46-cd, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap739b2b46-cd, col_values=(('qos', UUID('68c562d1-4512-48f7-9745-f4ff38b3826a')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap739b2b46-cd, col_values=(('external_ids', {'iface-id': '739b2b46-cd07-45c8-bca5-5d36c8c744b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:3a:2f', 'vm-uuid': 'fcafe860-22f2-4e7f-b1fc-d515c81762bc'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquired lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.network.neutron [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:29 user nova-compute[75239]: INFO os_vif [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd')
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328986222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328986222',id=20,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzePX1hT2woml8vSrOF8vsehzyoQyDIDpKzXNnSV7g611OdghErTyj7yzdlaSTAX9UCgl8tKvGNN0b/Ma50TAXHkeoKbz087TbCFE625mSyZ4RbQrLqedGEnT1H3VPyVA==',key_name='tempest-keypair-989254085',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fffa6e76e666484b8d3d4b66d58c1898',ramdisk_id='',reservation_id='r-fektjpro',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2035153286',owner_user_name='tempest-TaggedAttachmentsTest-2035153286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276cb9cf493a47a0a8a4ea045e3277c4',uuid=fcafe860-22f2-4e7f-b1fc-d515c81762bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converting VIF {"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] attach device xml: <interface type="ethernet">
Nov 13 20:39:29 user nova-compute[75239]:   <mac address="fa:16:3e:b2:3a:2f"/>
Nov 13 20:39:29 user nova-compute[75239]:   <model type="virtio"/>
Nov 13 20:39:29 user nova-compute[75239]:   <mtu size="1442"/>
Nov 13 20:39:29 user nova-compute[75239]:   <target dev="tap739b2b46-cd"/>
Nov 13 20:39:29 user nova-compute[75239]: </interface>
Nov 13 20:39:29 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] No BDM found with device name hda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:39:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] No VIF found with MAC fa:16:3e:8e:01:3d, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:39:30 user nova-compute[75239]:   <nova:package version="0.0.0"/>
Nov 13 20:39:30 user nova-compute[75239]:   <nova:name>tempest-device-tagging-server-1328986222</nova:name>
Nov 13 20:39:30 user nova-compute[75239]:   <nova:creationTime>2023-11-13 20:39:30</nova:creationTime>
Nov 13 20:39:30 user nova-compute[75239]:   <nova:flavor name="m1.tiny">
Nov 13 20:39:30 user nova-compute[75239]:     <nova:memory>512</nova:memory>
Nov 13 20:39:30 user nova-compute[75239]:     <nova:disk>1</nova:disk>
Nov 13 20:39:30 user nova-compute[75239]:     <nova:swap>0</nova:swap>
Nov 13 20:39:30 user nova-compute[75239]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:39:30 user nova-compute[75239]:     <nova:vcpus>1</nova:vcpus>
Nov 13 20:39:30 user nova-compute[75239]:   </nova:flavor>
Nov 13 20:39:30 user nova-compute[75239]:   <nova:owner>
Nov 13 20:39:30 user nova-compute[75239]:     <nova:user uuid="276cb9cf493a47a0a8a4ea045e3277c4">tempest-TaggedAttachmentsTest-2035153286-project-member</nova:user>
Nov 13 20:39:30 user nova-compute[75239]:     <nova:project uuid="fffa6e76e666484b8d3d4b66d58c1898">tempest-TaggedAttachmentsTest-2035153286</nova:project>
Nov 13 20:39:30 user nova-compute[75239]:   </nova:owner>
Nov 13 20:39:30 user nova-compute[75239]:   <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:39:30 user nova-compute[75239]:   <nova:ports>
Nov 13 20:39:30 user nova-compute[75239]:     <nova:port uuid="a8636abe-8a8c-471f-add4-dbec8745a4a4">
Nov 13 20:39:30 user nova-compute[75239]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:39:30 user nova-compute[75239]:     </nova:port>
Nov 13 20:39:30 user nova-compute[75239]:     <nova:port uuid="739b2b46-cd07-45c8-bca5-5d36c8c744b1">
Nov 13 20:39:30 user nova-compute[75239]:       <nova:ip type="fixed" address="10.10.10.41" ipVersion="4"/>
Nov 13 20:39:30 user nova-compute[75239]:     </nova:port>
Nov 13 20:39:30 user nova-compute[75239]:   </nova:ports>
Nov 13 20:39:30 user nova-compute[75239]: </nova:instance>
Nov 13 20:39:30 user nova-compute[75239]:  {{(pid=75239) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-50bc8754-4e16-4068-94a8-98ac6d5fd0f7 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "interface-fcafe860-22f2-4e7f-b1fc-d515c81762bc-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.918s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.objects.instance [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lazy-loading 'flavor' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-changed-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Refreshing instance network info cache due to event network-changed-70460a6e-b85a-4875-94c8-fa1917a78871. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] Acquiring lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:30 user nova-compute[75239]: INFO nova.compute.manager [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Attaching volume 61e4725e-01d4-4eb8-8dd9-f73536a7db96 to /dev/vdb
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-369a0262-31ad-471a-bf62-e878ef4c85a6 req-7331bb2e-a7a5-4cff-93fe-68624db24fcb service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updated VIF entry in instance network info cache for port 739b2b46-cd07-45c8-bca5-5d36c8c744b1. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-369a0262-31ad-471a-bf62-e878ef4c85a6 req-7331bb2e-a7a5-4cff-93fe-68624db24fcb service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updating instance_info_cache with network_info: [{"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-369a0262-31ad-471a-bf62-e878ef4c85a6 req-7331bb2e-a7a5-4cff-93fe-68624db24fcb service nova] Releasing lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.network.neutron [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updating instance_info_cache with network_info: [{"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG os_brick.utils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Releasing lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:39:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Creating image(s)
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[db870a5d-fa84-4df7-a5fd-fa3b0cb67cc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] Acquired lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Refreshing network info cache for port 70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG nova.objects.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<c3f6a68e-f57c-463f-81fd-e4e047421d5b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "442ba8ebb6f4369fdb27d36f3ee5a63009c35f44" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "442ba8ebb6f4369fdb27d36f3ee5a63009c35f44" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5cd413-d531-4554-a876-0af7859d34f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[89628571-ab73-4620-8655-c1f27ee8df90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[41db4d0d-3190-4df0-8348-dc4cb0957d20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:39:30 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:39:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[664d7a16-6923-40e9-81b2-7251cb6dad7b]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:39:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:39:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:39:31 user nova-compute[75239]: DEBUG os_brick.utils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:31 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updating existing volume attachment record: ec6ca846-27f5-4f55-83fe-03de2bc47f91 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 1.378s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG nova.virt.images [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] 55e8040e-9945-405a-bf79-6cd6c26c4353 was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44.part /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG nova.network.neutron [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updated VIF entry in instance network info cache for port 70460a6e-b85a-4875-94c8-fa1917a78871. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG nova.network.neutron [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updating instance_info_cache with network_info: [{"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] Releasing lock "refresh_cache-c3f6a68e-f57c-463f-81fd-e4e047421d5b" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-plugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-plugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:32 user nova-compute[75239]: WARNING nova.compute.manager [req-810b3bc4-63a9-4d8c-bd06-67e20d4cb727 req-f0f9d89b-8ca3-415f-9d17-679ba7b8767a service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-plugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 for instance with vm_state active and task_state None.
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44.part /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44.converted" returned: 0 in 0.911s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-c0fb6cfb-1aca-4c5e-8f88-1beb0a3b9240 req-b8f1bfc8-ef5d-4426-8a8d-ea6ff4aa2cbb service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-plugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c0fb6cfb-1aca-4c5e-8f88-1beb0a3b9240 req-b8f1bfc8-ef5d-4426-8a8d-ea6ff4aa2cbb service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c0fb6cfb-1aca-4c5e-8f88-1beb0a3b9240 req-b8f1bfc8-ef5d-4426-8a8d-ea6ff4aa2cbb service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c0fb6cfb-1aca-4c5e-8f88-1beb0a3b9240 req-b8f1bfc8-ef5d-4426-8a8d-ea6ff4aa2cbb service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-c0fb6cfb-1aca-4c5e-8f88-1beb0a3b9240 req-b8f1bfc8-ef5d-4426-8a8d-ea6ff4aa2cbb service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-plugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:33 user nova-compute[75239]: WARNING nova.compute.manager [req-c0fb6cfb-1aca-4c5e-8f88-1beb0a3b9240 req-b8f1bfc8-ef5d-4426-8a8d-ea6ff4aa2cbb service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-plugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 for instance with vm_state active and task_state None.
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:33 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:39:33 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7129MB free_disk=24.977725982666016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "442ba8ebb6f4369fdb27d36f3ee5a63009c35f44" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.537s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d67fcb6b-fb37-4d04-8dab-d74370f76981 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 55f96b7f-454c-440a-9c78-f91305569e87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1fe94db5-cf69-4e80-a779-e2182588ab56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance fcafe860-22f2-4e7f-b1fc-d515c81762bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f867644d-af12-4b8b-be06-ff6c00344095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (6c1abe79-622f-4b7b-89fd-35e20ccec6d4): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44 --force-share --output=json" returned: 0 in 0.195s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "442ba8ebb6f4369fdb27d36f3ee5a63009c35f44" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "442ba8ebb6f4369fdb27d36f3ee5a63009c35f44" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44 --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44,backing_fmt=raw /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44,backing_fmt=raw /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk 1073741824" returned: 0 in 0.058s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "442ba8ebb6f4369fdb27d36f3ee5a63009c35f44" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:39:33 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:39:34 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:39:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.727s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44 --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:34 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'migration_context' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:34 user nova-compute[75239]: DEBUG nova.objects.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<c3f6a68e-f57c-463f-81fd-e4e047421d5b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:39:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Rebasing disk image.
Nov 13 20:39:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 -F raw /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nawjkFPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:36 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:36 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:36 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc42ab4-2bf7-4829-8d03-2c95d07397b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:39:36 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea0c194-2ae8-4fa4-b4f1-35db0337c748]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96] added
Nov 13 20:39:36 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04bd788-cf72-4828-8928-77a3bea6a268]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc78691-b799-40f3-b8c0-67051523b560]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nawjkFPW {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nawjkFPW" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce1d31c-a6d5-4a0a-ad05-d34edcb85115]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nawjkFPW'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb733f1c-ec6b-4825-ab94-5eb59e7c520c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1087142-2f53-42f6-bd04-97199e9faecb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 -F raw /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk" returned: 0 in 2.449s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Ensure instance console log exists: /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Start _get_guest_xml network_info=[{"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='24d253969cea1d005d0617f9ce400b61',container_format='bare',created_at=2023-11-13T20:37:30Z,direct_url=<?>,disk_format='qcow2',id=55e8040e-9945-405a-bf79-6cd6c26c4353,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-123715306-shelved',owner='2d28d93b700143a988524063d92a102a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T20:37:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b13f3b32-78f8-47b3-8791-095078d30990', 'mount_device': '/dev/vdc', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtNaVeKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'c3f6a68e-f57c-463f-81fd-e4e047421d5b', 'attached_at': '', 'detached_at': '', 'volume_id': '60d6ec51-4db8-41b9-ad00-2637e6d888dc', 'serial': '60d6ec51-4db8-41b9-ad00-2637e6d888dc'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:39:36 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='24d253969cea1d005d0617f9ce400b61',container_format='bare',created_at=2023-11-13T20:37:30Z,direct_url=<?>,disk_format='qcow2',id=55e8040e-9945-405a-bf79-6cd6c26c4353,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-123715306-shelved',owner='2d28d93b700143a988524063d92a102a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T20:37:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.objects.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<c3f6a68e-f57c-463f-81fd-e4e047421d5b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtNaVeKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:36 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5c1a7b-05e5-4a65-9ba3-3021c9cde16c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96, portal: 172.16.0.220,3260]
Nov 13 20:39:36 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96, portal: 172.16.0.220,3260] successful.
Nov 13 20:39:36 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[98872e01-3f02-4064-9531-29040be188d6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6362c686-1478-4f95-8885-61b8b719f8d5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:36 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa638d7-fb31-4a6a-8266-fedaccba5e1c]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:36 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nawjkFPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] <== connect_volume: return (1436ms) {'type': 'block', 'scsi_wwn': '23164346239666133', 'path': '/dev/sdd'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164346239666133', 'path': '/dev/sdd'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.109s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:37 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:37 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG nova.objects.instance [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lazy-loading 'flavor' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f548a33-4df6-4005-a932-3650b02d82b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:39:37 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:39:37 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:39:37 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:39:37 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:39:37 user nova-compute[75239]:   <serial>61e4725e-01d4-4eb8-8dd9-f73536a7db96</serial>
Nov 13 20:39:37 user nova-compute[75239]: </disk>
Nov 13 20:39:37 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd9d0e5-de7a-4aab-9f40-e3ce75408f87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc] added
Nov 13 20:39:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.187s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2854db-dfe0-4247-adf8-114d77a5985a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30efc44-a8ac-41cd-a555-dd0b06e16454]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtNaVeKX {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OtNaVeKX" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad67810-2c95-46bd-9dd3-9b8bfe512793]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OtNaVeKX'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa647dfa-f5dd-4f5f-8bf9-5d8c1cd81789]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[931dd9ee-a394-4008-b227-910304b6a2f6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating instance_info_cache with network_info: [{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2a5fd0-c103-4dec-9350-cf2f32891cb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc, portal: 172.16.0.220,3260]
Nov 13 20:39:38 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc, portal: 172.16.0.220,3260] successful.
Nov 13 20:39:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[445adea4-ecfd-4a76-9aff-999671a1ba83]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea80c65-f710-41be-80b1-dacfa0474c75]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:38 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.613s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] HCTL ('41', '-', '-', 0) found on session 27 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17ece8b-8452-4057-9747-b79a63a3efd5]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Searching for a device in session 27 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtNaVeKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] No BDM found with device name hda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] No VIF found with MAC fa:16:3e:8e:01:3d, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-552ab934-21f4-4aee-a765-81c115cb45ac req-39e83561-737d-444a-bab8-2790d57625c7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-changed-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-552ab934-21f4-4aee-a765-81c115cb45ac req-39e83561-737d-444a-bab8-2790d57625c7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing instance network info cache due to event network-changed-77d1bec8-0075-42a5-ae4c-85e20523b131. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-552ab934-21f4-4aee-a765-81c115cb45ac req-39e83561-737d-444a-bab8-2790d57625c7 service nova] Acquiring lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-552ab934-21f4-4aee-a765-81c115cb45ac req-39e83561-737d-444a-bab8-2790d57625c7 service nova] Acquired lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-552ab934-21f4-4aee-a765-81c115cb45ac req-39e83561-737d-444a-bab8-2790d57625c7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Refreshing network info cache for port 77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:39:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-078054a7-eedb-45dd-9fba-89e4fd371398 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.098s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.network.neutron [req-552ab934-21f4-4aee-a765-81c115cb45ac req-39e83561-737d-444a-bab8-2790d57625c7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updated VIF entry in instance network info cache for port 77d1bec8-0075-42a5-ae4c-85e20523b131. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.network.neutron [req-552ab934-21f4-4aee-a765-81c115cb45ac req-39e83561-737d-444a-bab8-2790d57625c7 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [{"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-552ab934-21f4-4aee-a765-81c115cb45ac req-39e83561-737d-444a-bab8-2790d57625c7 service nova] Releasing lock "refresh_cache-f867644d-af12-4b8b-be06-ff6c00344095" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.652s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] <== connect_volume: return (2761ms) {'type': 'block', 'scsi_wwn': '23331646434353061', 'path': '/dev/sdj'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331646434353061', 'path': '/dev/sdj'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123715306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123715306',id=13,image_ref='55e8040e-9945-405a-bf79-6cd6c26c4353',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2045310531',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-26o52j6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member',shelved_at='2023-11-13T20:37:37.054947',shelved_host='user',shelved_image_id='55e8040e-9945-405a-bf79-6cd6c26c4353'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=c3f6a68e-f57c-463f-81fd-e4e047421d5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'pci_devices' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.objects.base [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<c3f6a68e-f57c-463f-81fd-e4e047421d5b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:39:39 user nova-compute[75239]:   <uuid>c3f6a68e-f57c-463f-81fd-e4e047421d5b</uuid>
Nov 13 20:39:39 user nova-compute[75239]:   <name>instance-0000000d</name>
Nov 13 20:39:39 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:39:39 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:39:39 user nova-compute[75239]:   <metadata>
Nov 13 20:39:39 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:39:39 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:39:39 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-123715306</nova:name>
Nov 13 20:39:39 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:39:36</nova:creationTime>
Nov 13 20:39:39 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:39:39 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:39:39 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:39:39 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:39:39 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:39:39 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:39:39 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:39:39 user nova-compute[75239]:       <nova:owner>
Nov 13 20:39:39 user nova-compute[75239]:         <nova:user uuid="21fc417bc25944ffb15dd30f9d7f0760">tempest-AttachVolumeShelveTestJSON-2022096331-project-member</nova:user>
Nov 13 20:39:39 user nova-compute[75239]:         <nova:project uuid="2d28d93b700143a988524063d92a102a">tempest-AttachVolumeShelveTestJSON-2022096331</nova:project>
Nov 13 20:39:39 user nova-compute[75239]:       </nova:owner>
Nov 13 20:39:39 user nova-compute[75239]:       <nova:root type="image" uuid="55e8040e-9945-405a-bf79-6cd6c26c4353"/>
Nov 13 20:39:39 user nova-compute[75239]:       <nova:ports>
Nov 13 20:39:39 user nova-compute[75239]:         <nova:port uuid="70460a6e-b85a-4875-94c8-fa1917a78871">
Nov 13 20:39:39 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 20:39:39 user nova-compute[75239]:         </nova:port>
Nov 13 20:39:39 user nova-compute[75239]:       </nova:ports>
Nov 13 20:39:39 user nova-compute[75239]:     </nova:instance>
Nov 13 20:39:39 user nova-compute[75239]:   </metadata>
Nov 13 20:39:39 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:39:39 user nova-compute[75239]:     <system>
Nov 13 20:39:39 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:39:39 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:39:39 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:39:39 user nova-compute[75239]:       <entry name="serial">c3f6a68e-f57c-463f-81fd-e4e047421d5b</entry>
Nov 13 20:39:39 user nova-compute[75239]:       <entry name="uuid">c3f6a68e-f57c-463f-81fd-e4e047421d5b</entry>
Nov 13 20:39:39 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:39:39 user nova-compute[75239]:     </system>
Nov 13 20:39:39 user nova-compute[75239]:   </sysinfo>
Nov 13 20:39:39 user nova-compute[75239]:   <os>
Nov 13 20:39:39 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:39:39 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:39:39 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:39:39 user nova-compute[75239]:   </os>
Nov 13 20:39:39 user nova-compute[75239]:   <features>
Nov 13 20:39:39 user nova-compute[75239]:     <acpi/>
Nov 13 20:39:39 user nova-compute[75239]:     <apic/>
Nov 13 20:39:39 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:39:39 user nova-compute[75239]:   </features>
Nov 13 20:39:39 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:39:39 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:39:39 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:39:39 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:39:39 user nova-compute[75239]:   </clock>
Nov 13 20:39:39 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:39:39 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:39:39 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:39:39 user nova-compute[75239]:   </cpu>
Nov 13 20:39:39 user nova-compute[75239]:   <devices>
Nov 13 20:39:39 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:39:39 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:39:39 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk"/>
Nov 13 20:39:39 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:39:39 user nova-compute[75239]:     </disk>
Nov 13 20:39:39 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:39:39 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:39:39 user nova-compute[75239]:       <source dev="/dev/sdj"/>
Nov 13 20:39:39 user nova-compute[75239]:       <target dev="vdc" bus="virtio"/>
Nov 13 20:39:39 user nova-compute[75239]:       <serial>60d6ec51-4db8-41b9-ad00-2637e6d888dc</serial>
Nov 13 20:39:39 user nova-compute[75239]:     </disk>
Nov 13 20:39:39 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:39:39 user nova-compute[75239]:       <mac address="fa:16:3e:1b:c8:80"/>
Nov 13 20:39:39 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:39:39 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:39:39 user nova-compute[75239]:       <target dev="tap70460a6e-b8"/>
Nov 13 20:39:39 user nova-compute[75239]:     </interface>
Nov 13 20:39:39 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:39:39 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/console.log" append="off"/>
Nov 13 20:39:39 user nova-compute[75239]:     </serial>
Nov 13 20:39:39 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:39:39 user nova-compute[75239]:     <video>
Nov 13 20:39:39 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:39:39 user nova-compute[75239]:     </video>
Nov 13 20:39:39 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:39:39 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:39:39 user nova-compute[75239]:     </rng>
Nov 13 20:39:39 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:39:39 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:39:39 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:39:39 user nova-compute[75239]:     </memballoon>
Nov 13 20:39:39 user nova-compute[75239]:   </devices>
Nov 13 20:39:39 user nova-compute[75239]: </domain>
Nov 13 20:39:39 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123715306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123715306',id=13,image_ref='55e8040e-9945-405a-bf79-6cd6c26c4353',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2045310531',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:35:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-26o52j6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member',shelved_at='2023-11-13T20:37:37.054947',shelved_host='user',shelved_image_id='55e8040e-9945-405a-bf79-6cd6c26c4353'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=c3f6a68e-f57c-463f-81fd-e4e047421d5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG os_vif [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2adefc7c-3663-5f2c-912d-2b15301a4db1', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70460a6e-b8, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70460a6e-b8, col_values=(('qos', UUID('78e45787-1768-4a63-bd59-d2974b9da805')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70460a6e-b8, col_values=(('external_ids', {'iface-id': '70460a6e-b85a-4875-94c8-fa1917a78871', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:c8:80', 'vm-uuid': 'c3f6a68e-f57c-463f-81fd-e4e047421d5b'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:39 user nova-compute[75239]: INFO os_vif [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8')
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:39:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] No VIF found with MAC fa:16:3e:1b:c8:80, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:40 user nova-compute[75239]: INFO nova.compute.manager [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Detaching volume 61e4725e-01d4-4eb8-8dd9-f73536a7db96
Nov 13 20:39:40 user nova-compute[75239]: INFO nova.virt.block_device [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Attempting to driver detach volume 61e4725e-01d4-4eb8-8dd9-f73536a7db96 from mountpoint /dev/vdb
Nov 13 20:39:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Attempting to detach device vdb from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:39:40 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:39:40 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:39:40 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:39:40 user nova-compute[75239]:   <serial>61e4725e-01d4-4eb8-8dd9-f73536a7db96</serial>
Nov 13 20:39:40 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 20:39:40 user nova-compute[75239]: </disk>
Nov 13 20:39:40 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:39:40 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Successfully detached device vdb from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc from the persistent domain config.
Nov 13 20:39:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:39:40 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:39:40 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:39:40 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:39:40 user nova-compute[75239]:   <serial>61e4725e-01d4-4eb8-8dd9-f73536a7db96</serial>
Nov 13 20:39:40 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 20:39:40 user nova-compute[75239]: </disk>
Nov 13 20:39:40 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:40 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:39:40 user nova-compute[75239]: INFO nova.compute.claims [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Claim successful on node user
Nov 13 20:39:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "f867644d-af12-4b8b-be06-ff6c00344095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:39:41 user nova-compute[75239]: INFO nova.compute.manager [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Terminating instance
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.policy [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c880ecddd16344ae92fdd8916db586d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4d33674f2f4221a2a17f5510135ba8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:39:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Creating image(s)
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "/opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "/opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "/opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.225s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-a8ee4769-f033-4db9-9ebb-ba94232f0cec req-5b7f04c0-e8a6-4db6-8d45-dceac4e28180 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a8ee4769-f033-4db9-9ebb-ba94232f0cec req-5b7f04c0-e8a6-4db6-8d45-dceac4e28180 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a8ee4769-f033-4db9-9ebb-ba94232f0cec req-5b7f04c0-e8a6-4db6-8d45-dceac4e28180 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a8ee4769-f033-4db9-9ebb-ba94232f0cec req-5b7f04c0-e8a6-4db6-8d45-dceac4e28180 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-a8ee4769-f033-4db9-9ebb-ba94232f0cec req-5b7f04c0-e8a6-4db6-8d45-dceac4e28180 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-unplugged-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-a8ee4769-f033-4db9-9ebb-ba94232f0cec req-5b7f04c0-e8a6-4db6-8d45-dceac4e28180 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-77d1bec8-0075-42a5-ae4c-85e20523b131 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.205s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk 1073741824" returned: 0 in 0.064s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Successfully created port: 112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-cad0f34f-2de6-4486-aa01-cc9f3a43a979 req-db937ca4-dba0-4aaf-ae13-6c27c2db6f14 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cad0f34f-2de6-4486-aa01-cc9f3a43a979 req-db937ca4-dba0-4aaf-ae13-6c27c2db6f14 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cad0f34f-2de6-4486-aa01-cc9f3a43a979 req-db937ca4-dba0-4aaf-ae13-6c27c2db6f14 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cad0f34f-2de6-4486-aa01-cc9f3a43a979 req-db937ca4-dba0-4aaf-ae13-6c27c2db6f14 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-cad0f34f-2de6-4486-aa01-cc9f3a43a979 req-db937ca4-dba0-4aaf-ae13-6c27c2db6f14 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-unplugged-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-cad0f34f-2de6-4486-aa01-cc9f3a43a979 req-db937ca4-dba0-4aaf-ae13-6c27c2db6f14 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-92b00a74-9a51-477d-8010-e2f86e1cabbf for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Cannot resize image /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Ensure instance console log exists: /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Successfully updated port: 112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquired lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:39:43 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 is timed out.
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-e08030e8-784e-410a-b86f-dd76fc5e48a6 req-2ae58385-c16f-4950-aa2a-ec112f8ff7dc service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-changed-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-e08030e8-784e-410a-b86f-dd76fc5e48a6 req-2ae58385-c16f-4950-aa2a-ec112f8ff7dc service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Refreshing instance network info cache due to event network-changed-112c3460-96e2-4760-b161-d7a6fd9b3535. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e08030e8-784e-410a-b86f-dd76fc5e48a6 req-2ae58385-c16f-4950-aa2a-ec112f8ff7dc service nova] Acquiring lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:39:43 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Successfully detached device vdb from instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 from the live domain config.
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VFPSBHUa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:43 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.neutron [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce07247-dcc0-4c45-8f3a-6260f08e79a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:39:43 user nova-compute[75239]: No targets found.
Nov 13 20:39:43 user nova-compute[75239]: iSNS:
Nov 13 20:39:43 user nova-compute[75239]: No targets found.
Nov 13 20:39:43 user nova-compute[75239]: STATIC:
Nov 13 20:39:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:39:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:39:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:39:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6
Nov 13 20:39:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030
Nov 13 20:39:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96
Nov 13 20:39:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:39:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc
Nov 13 20:39:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c
Nov 13 20:39:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:43 user nova-compute[75239]: FIRMWARE:
Nov 13 20:39:43 user nova-compute[75239]: No targets found.
Nov 13 20:39:43 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:39:43 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:39:43 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18a8e5a-c124-4e45-a940-ae9eb763349b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[702ed15b-2275-4f28-a6ad-5b9671a23961]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:43 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:43 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:43 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d84288550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6'): ({'sde'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Removing single pathed devices sde {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Instance destroyed successfully.
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.objects.instance [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lazy-loading 'resources' on Instance uuid f867644d-af12-4b8b-be06-ff6c00344095 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d924b4-eda9-4274-a73b-ff4ece9a4e0c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "77d1bec8-0075-42a5-ae4c-85e20523b131", "address": "fa:16:3e:02:55:08", "network": {"id": "7b8e659e-516e-4298-9894-605199d2bba3", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2067831182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77d1bec8-00", "ovs_interfaceid": "77d1bec8-0075-42a5-ae4c-85e20523b131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:55:08,bridge_name='br-int',has_traffic_filtering=True,id=77d1bec8-0075-42a5-ae4c-85e20523b131,network=Network(7b8e659e-516e-4298-9894-605199d2bba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d1bec8-00') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:55:08,bridge_name='br-int',has_traffic_filtering=True,id=77d1bec8-0075-42a5-ae4c-85e20523b131,network=Network(7b8e659e-516e-4298-9894-605199d2bba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d1bec8-00') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77d1bec8-00, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[427de06f-007c-41aa-9cbd-6a222badd0c4]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Flushing IO for device /dev/sde {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17701dfc-9077-4b3f-a7fe-bfc86fe7a35f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[af97fb7e-c0ec-4350-b62b-c9ca55c23d49]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2f5d72ac', '/dev/disk/by-id/scsi-1SCST_BIO2f5d72ac-3fce54d6dc28ccc8', '/dev/disk/by-id/scsi-23366636535346436') {{(pid=86402) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d210da25-3e4d-4278-84c8-54e138b907cb]: (4, None) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48bb16b-052e-4af4-b999-da671c2bb2b1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e139cec7-5ded-4913-b1d6-da8f3c761190) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: INFO os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:55:08,bridge_name='br-int',has_traffic_filtering=True,id=77d1bec8-0075-42a5-ae4c-85e20523b131,network=Network(7b8e659e-516e-4298-9894-605199d2bba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77d1bec8-00')
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:af:00,bridge_name='br-int',has_traffic_filtering=True,id=f2b9f7ee-3832-401a-b4c0-4620bfed1148,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2b9f7ee-38') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:af:00,bridge_name='br-int',has_traffic_filtering=True,id=f2b9f7ee-3832-401a-b4c0-4620bfed1148,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2b9f7ee-38') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2b9f7ee-38, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a7b083-483b-4ffc-82d3-be1ab1aa39a1]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6, portal: 172.16.0.220,3260]
Nov 13 20:39:43 user nova-compute[75239]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6, portal: 172.16.0.220,3260] successful.
Nov 13 20:39:43 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e3bc74-88d2-4032-b831-909172ab11f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a376308-71d7-4d50-be43-b1820a606c46]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] <== disconnect_volume: return (454ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adc8d476-d570-45ae-9ff7-c838638bc3a8) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: INFO os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:af:00,bridge_name='br-int',has_traffic_filtering=True,id=f2b9f7ee-3832-401a-b4c0-4620bfed1148,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2b9f7ee-38')
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7d:1d,bridge_name='br-int',has_traffic_filtering=True,id=b79d0880-dc18-45b3-ad95-09fd3ff58395,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb79d0880-dc') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7d:1d,bridge_name='br-int',has_traffic_filtering=True,id=b79d0880-dc18-45b3-ad95-09fd3ff58395,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb79d0880-dc') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb79d0880-dc, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9db23457-9e4b-4a20-8620-a567c8a8ef4a) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:39:43 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance spawned successfully.
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: INFO os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:7d:1d,bridge_name='br-int',has_traffic_filtering=True,id=b79d0880-dc18-45b3-ad95-09fd3ff58395,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb79d0880-dc')
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=200b2855-5a4a-4ef4-b4d2-a3328f7d8637,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap200b2855-5a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=200b2855-5a4a-4ef4-b4d2-a3328f7d8637,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap200b2855-5a') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap200b2855-5a, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b542ece1-e128-4124-bc0c-f1bacecc0cda) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: INFO os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:7f:5f,bridge_name='br-int',has_traffic_filtering=True,id=200b2855-5a4a-4ef4-b4d2-a3328f7d8637,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap200b2855-5a')
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:71:89,bridge_name='br-int',has_traffic_filtering=True,id=92b00a74-9a51-477d-8010-e2f86e1cabbf,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b00a74-9a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:71:89,bridge_name='br-int',has_traffic_filtering=True,id=92b00a74-9a51-477d-8010-e2f86e1cabbf,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b00a74-9a') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92b00a74-9a, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fcc1adb-ef70-463e-9e25-70d46f2d3db8) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: INFO os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:71:89,bridge_name='br-int',has_traffic_filtering=True,id=92b00a74-9a51-477d-8010-e2f86e1cabbf,network=Network(bf5fad07-c66f-4019-8287-008b3649ca01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92b00a74-9a')
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:9f:95,bridge_name='br-int',has_traffic_filtering=True,id=42a122d2-f18d-46a5-9b9b-fb60602bfe82,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a122d2-f1') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:9f:95,bridge_name='br-int',has_traffic_filtering=True,id=42a122d2-f18d-46a5-9b9b-fb60602bfe82,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a122d2-f1') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42a122d2-f1, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=578d2bcc-b73a-4a9a-a44d-859943f67ecb) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.neutron [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating instance_info_cache with network_info: [{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: INFO os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:9f:95,bridge_name='br-int',has_traffic_filtering=True,id=42a122d2-f18d-46a5-9b9b-fb60602bfe82,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42a122d2-f1')
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1941988757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1941988757',id=21,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWQ4r5uDm31Jju5T1GVO2y40y7hgF8Z7gczbv+NLcBW+4gtDsBiU8dM0v20YPF2jnrUpFnf6JJtK41tuIfJm9CfFvOPLHgGG6qhYpxj0opFX+2wITzOKcctTetPDZVg7Q==',key_name='tempest-keypair-176757021',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:38:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cee07325ee534b3a92cb18de0fc6a748',ramdisk_id='',reservation_id='r-5ngefafs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1283413932',owner_user_name='tempest-TaggedBootDevicesTest_v242-1283413932-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a8e4901f8094f61a7189ee21d85f65a',uuid=f867644d-af12-4b8b-be06-ff6c00344095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converting VIF {"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:29:52,bridge_name='br-int',has_traffic_filtering=True,id=f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ccc5fa-9e') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:29:52,bridge_name='br-int',has_traffic_filtering=True,id=f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ccc5fa-9e') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Releasing lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance network_info: |[{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7ccc5fa-9e, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e08030e8-784e-410a-b86f-dd76fc5e48a6 req-2ae58385-c16f-4950-aa2a-ec112f8ff7dc service nova] Acquired lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:39:43 user nova-compute[75239]: DEBUG nova.network.neutron [req-e08030e8-784e-410a-b86f-dd76fc5e48a6 req-2ae58385-c16f-4950-aa2a-ec112f8ff7dc service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Refreshing network info cache for port 112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Start _get_guest_xml network_info=[{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:44 user nova-compute[75239]: WARNING nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-77d1bec8-0075-42a5-ae4c-85e20523b131 for instance with vm_state active and task_state deleting.
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-unplugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:44 user nova-compute[75239]: WARNING nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 for instance with vm_state active and task_state deleting.
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-unplugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:44 user nova-compute[75239]: WARNING nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-42a122d2-f18d-46a5-9b9b-fb60602bfe82 for instance with vm_state active and task_state deleting.
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-unplugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:44 user nova-compute[75239]: WARNING nova.compute.manager [req-d9b34bef-740e-48ca-ae11-0827d092ca41 req-f121db65-d919-4b34-9a97-5b472cd3fa44 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 for instance with vm_state active and task_state deleting.
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5630a1bc-133d-41fa-aefe-9bfe70661d2b) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: INFO os_vif [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:29:52,bridge_name='br-int',has_traffic_filtering=True,id=f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7,network=Network(102ee64c-2724-4b64-9853-b34dd9c48950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7ccc5fa-9e')
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NMfDZdsC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:39:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:39:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-16569669',display_name='tempest-ServerActionsTestOtherB-server-16569669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-16569669',id=22,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3cgFTuxZU0r1DOz9OMgd6sE59YAs74F2EMnqYDQDB93Sr2devQa1xYepd0PJ2KrqjVYzoEFlJaWxo0ebxb5mBVEX1HkJ8Mn4KaHB/8mBjirpfPmOT2iYwed690kLau+A==',key_name='tempest-keypair-1787385900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4d33674f2f4221a2a17f5510135ba8',ramdisk_id='',reservation_id='r-cxa24fp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-94146296',owner_user_name='tempest-ServerActionsTestOtherB-94146296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:39:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c880ecddd16344ae92fdd8916db586d5',uuid=e92c1cc5-07e5-4bd2-8e58-e397e16b1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converting VIF {"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.objects.instance [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lazy-loading 'pci_devices' on Instance uuid e92c1cc5-07e5-4bd2-8e58-e397e16b1300 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a964e590-ea3a-4be4-a207-5770d12fda49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:39:44 user nova-compute[75239]: No targets found.
Nov 13 20:39:44 user nova-compute[75239]: iSNS:
Nov 13 20:39:44 user nova-compute[75239]: No targets found.
Nov 13 20:39:44 user nova-compute[75239]: STATIC:
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: FIRMWARE:
Nov 13 20:39:44 user nova-compute[75239]: No targets found.
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:39:44 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:39:44 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:39:44 user nova-compute[75239]:   <uuid>e92c1cc5-07e5-4bd2-8e58-e397e16b1300</uuid>
Nov 13 20:39:44 user nova-compute[75239]:   <name>instance-00000016</name>
Nov 13 20:39:44 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:39:44 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:39:44 user nova-compute[75239]:   <metadata>
Nov 13 20:39:44 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:39:44 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:39:44 user nova-compute[75239]:       <nova:name>tempest-ServerActionsTestOtherB-server-16569669</nova:name>
Nov 13 20:39:44 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:39:44</nova:creationTime>
Nov 13 20:39:44 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:39:44 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:39:44 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:39:44 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:39:44 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:39:44 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:39:44 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:39:44 user nova-compute[75239]:       <nova:owner>
Nov 13 20:39:44 user nova-compute[75239]:         <nova:user uuid="c880ecddd16344ae92fdd8916db586d5">tempest-ServerActionsTestOtherB-94146296-project-member</nova:user>
Nov 13 20:39:44 user nova-compute[75239]:         <nova:project uuid="0f4d33674f2f4221a2a17f5510135ba8">tempest-ServerActionsTestOtherB-94146296</nova:project>
Nov 13 20:39:44 user nova-compute[75239]:       </nova:owner>
Nov 13 20:39:44 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:39:44 user nova-compute[75239]:       <nova:ports>
Nov 13 20:39:44 user nova-compute[75239]:         <nova:port uuid="112c3460-96e2-4760-b161-d7a6fd9b3535">
Nov 13 20:39:44 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:39:44 user nova-compute[75239]:         </nova:port>
Nov 13 20:39:44 user nova-compute[75239]:       </nova:ports>
Nov 13 20:39:44 user nova-compute[75239]:     </nova:instance>
Nov 13 20:39:44 user nova-compute[75239]:   </metadata>
Nov 13 20:39:44 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:39:44 user nova-compute[75239]:     <system>
Nov 13 20:39:44 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:39:44 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:39:44 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:39:44 user nova-compute[75239]:       <entry name="serial">e92c1cc5-07e5-4bd2-8e58-e397e16b1300</entry>
Nov 13 20:39:44 user nova-compute[75239]:       <entry name="uuid">e92c1cc5-07e5-4bd2-8e58-e397e16b1300</entry>
Nov 13 20:39:44 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:39:44 user nova-compute[75239]:     </system>
Nov 13 20:39:44 user nova-compute[75239]:   </sysinfo>
Nov 13 20:39:44 user nova-compute[75239]:   <os>
Nov 13 20:39:44 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:39:44 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:39:44 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:39:44 user nova-compute[75239]:   </os>
Nov 13 20:39:44 user nova-compute[75239]:   <features>
Nov 13 20:39:44 user nova-compute[75239]:     <acpi/>
Nov 13 20:39:44 user nova-compute[75239]:     <apic/>
Nov 13 20:39:44 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:39:44 user nova-compute[75239]:   </features>
Nov 13 20:39:44 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:39:44 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:39:44 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:39:44 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:39:44 user nova-compute[75239]:   </clock>
Nov 13 20:39:44 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:39:44 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:39:44 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:39:44 user nova-compute[75239]:   </cpu>
Nov 13 20:39:44 user nova-compute[75239]:   <devices>
Nov 13 20:39:44 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:39:44 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:39:44 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk"/>
Nov 13 20:39:44 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:39:44 user nova-compute[75239]:     </disk>
Nov 13 20:39:44 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:39:44 user nova-compute[75239]:       <mac address="fa:16:3e:13:86:a6"/>
Nov 13 20:39:44 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:39:44 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:39:44 user nova-compute[75239]:       <target dev="tap112c3460-96"/>
Nov 13 20:39:44 user nova-compute[75239]:     </interface>
Nov 13 20:39:44 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:39:44 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/console.log" append="off"/>
Nov 13 20:39:44 user nova-compute[75239]:     </serial>
Nov 13 20:39:44 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:39:44 user nova-compute[75239]:     <video>
Nov 13 20:39:44 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:39:44 user nova-compute[75239]:     </video>
Nov 13 20:39:44 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:39:44 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:39:44 user nova-compute[75239]:     </rng>
Nov 13 20:39:44 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:39:44 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:39:44 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:39:44 user nova-compute[75239]:     </memballoon>
Nov 13 20:39:44 user nova-compute[75239]:   </devices>
Nov 13 20:39:44 user nova-compute[75239]: </domain>
Nov 13 20:39:44 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-16569669',display_name='tempest-ServerActionsTestOtherB-server-16569669',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-16569669',id=22,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3cgFTuxZU0r1DOz9OMgd6sE59YAs74F2EMnqYDQDB93Sr2devQa1xYepd0PJ2KrqjVYzoEFlJaWxo0ebxb5mBVEX1HkJ8Mn4KaHB/8mBjirpfPmOT2iYwed690kLau+A==',key_name='tempest-keypair-1787385900',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4d33674f2f4221a2a17f5510135ba8',ramdisk_id='',reservation_id='r-cxa24fp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-94146296',owner_user_name='tempest-ServerActionsTestOtherB-94146296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:39:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c880ecddd16344ae92fdd8916db586d5',uuid=e92c1cc5-07e5-4bd2-8e58-e397e16b1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converting VIF {"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_vif [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de48b76b-f3c1-5fb9-a92f-e187e43e3ade', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[64509555-0de8-4bd8-a534-fc59a6696ea4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap112c3460-96, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap112c3460-96, col_values=(('qos', UUID('c44645ea-0741-4a42-9634-26bebb3f65bc')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap112c3460-96, col_values=(('external_ids', {'iface-id': '112c3460-96e2-4760-b161-d7a6fd9b3535', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:86:a6', 'vm-uuid': 'e92c1cc5-07e5-4bd2-8e58-e397e16b1300'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4007dc17-648e-4c9d-80f2-34049eab0bde tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 21.105s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:44 user nova-compute[75239]: INFO os_vif [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96')
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5e4bec-5bd0-4d3f-b851-7667deb4e396]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8424eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c'): ({'sdf'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Removing single pathed devices sdf {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4558edc-c8c8-44c3-95de-da086873fed7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab5bd8-85de-46f6-b496-af00d2adf85c]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Flushing IO for device /dev/sdf {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] No VIF found with MAC fa:16:3e:13:86:a6, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7936d35-39c1-4b11-9a17-11b6f05113eb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[713da05e-4ffa-4354-96f1-5b1f47ef22f8]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] SCSI volumes sdf have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.objects.instance [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'flavor' on Instance uuid 1ec27628-db61-49c0-951b-6e72ac2f4f15 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bf4591-0515-4d9a-ae65-66f491d8cda5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5e6b1f8d-812c-48a3-a2d1-f8a633280e46 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.041s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-b6c74f9d-1716-4b3c-a372-9a1fdaa64d40 req-32bc453a-c820-4235-8d7a-2e5530ffa00b service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b6c74f9d-1716-4b3c-a372-9a1fdaa64d40 req-32bc453a-c820-4235-8d7a-2e5530ffa00b service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b6c74f9d-1716-4b3c-a372-9a1fdaa64d40 req-32bc453a-c820-4235-8d7a-2e5530ffa00b service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b6c74f9d-1716-4b3c-a372-9a1fdaa64d40 req-32bc453a-c820-4235-8d7a-2e5530ffa00b service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-b6c74f9d-1716-4b3c-a372-9a1fdaa64d40 req-32bc453a-c820-4235-8d7a-2e5530ffa00b service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:44 user nova-compute[75239]: WARNING nova.compute.manager [req-b6c74f9d-1716-4b3c-a372-9a1fdaa64d40 req-32bc453a-c820-4235-8d7a-2e5530ffa00b service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-92b00a74-9a51-477d-8010-e2f86e1cabbf for instance with vm_state active and task_state deleting.
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6027c27c-5511-45b9-ac73-c571c8b04532]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c, portal: 172.16.0.220,3260]
Nov 13 20:39:44 user nova-compute[75239]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c, portal: 172.16.0.220,3260] successful.
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e7342345-3b13-452f-bb61-dc3d012ceb2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42ca45b-0945-4b8d-9245-3307935e1349]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] <== disconnect_volume: return (446ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JznDxBEf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8021decb-eb45-4f69-a9b5-b4668b1bcb3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:39:44 user nova-compute[75239]: No targets found.
Nov 13 20:39:44 user nova-compute[75239]: iSNS:
Nov 13 20:39:44 user nova-compute[75239]: No targets found.
Nov 13 20:39:44 user nova-compute[75239]: STATIC:
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: FIRMWARE:
Nov 13 20:39:44 user nova-compute[75239]: No targets found.
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:39:44 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:39:44 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc82e913-1a3b-43c1-8289-5d965bb71b96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa49c84b-61c7-4f9d-8c1c-6a13a6bb7123]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8424eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030'): ({'sdg'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Removing single pathed devices sdg {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b67e40-6ae3-40da-bd80-f29c8a098c65]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdcc388-3265-40f4-8ae8-ac5992eb9cf7]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Flushing IO for device /dev/sdg {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-e08030e8-784e-410a-b86f-dd76fc5e48a6 req-2ae58385-c16f-4950-aa2a-ec112f8ff7dc service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updated VIF entry in instance network info cache for port 112c3460-96e2-4760-b161-d7a6fd9b3535. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-e08030e8-784e-410a-b86f-dd76fc5e48a6 req-2ae58385-c16f-4950-aa2a-ec112f8ff7dc service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating instance_info_cache with network_info: [{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ef2dcb-1ab3-4d85-b9fb-3782076566a9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e08030e8-784e-410a-b86f-dd76fc5e48a6 req-2ae58385-c16f-4950-aa2a-ec112f8ff7dc service nova] Releasing lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35e511e-d88c-4a76-8d92-62742dad68d8]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7efdb6-c5a6-43d9-8825-f6c0ad4cf101]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ca6ea9-c75a-4261-9543-807e6c33369c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030, portal: 172.16.0.220,3260]
Nov 13 20:39:44 user nova-compute[75239]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030, portal: 172.16.0.220,3260] successful.
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6258033b-be24-418d-b1dc-f751db320030 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[641cd3b9-68b9-4dfb-a5a6-c458821f5765]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] <== disconnect_volume: return (378ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eJNnhXvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:39:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d9eb1-7be9-42a5-a6fe-8a5b5d83c403]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:39:44 user nova-compute[75239]: No targets found.
Nov 13 20:39:44 user nova-compute[75239]: iSNS:
Nov 13 20:39:44 user nova-compute[75239]: No targets found.
Nov 13 20:39:44 user nova-compute[75239]: STATIC:
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc
Nov 13 20:39:44 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:39:44 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:39:44 user nova-compute[75239]: FIRMWARE:
Nov 13 20:39:44 user nova-compute[75239]: No targets found.
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:39:44 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:39:44 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c24fe4a-cb17-4236-ac09-394c32be17b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[83596803-7d6e-40dd-81c2-5ccb58645460]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:44 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:39:45 user nova-compute[75239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b (non-flash)
Nov 13 20:39:45 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:39:45 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:39:45 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:39:45 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:39:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d84225510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b'): ({'sdh'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Removing single pathed devices sdh {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5077c9f3-da27-4cd2-b94e-ed7993f4ed5e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f062b538-14c2-4d61-8d31-8d7fa6523393]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Flushing IO for device /dev/sdh {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] No waiting events found dispatching network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:45 user nova-compute[75239]: WARNING nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received unexpected event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 for instance with vm_state active and task_state None.
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] No waiting events found dispatching network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:45 user nova-compute[75239]: WARNING nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received unexpected event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 for instance with vm_state active and task_state None.
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-unplugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:45 user nova-compute[75239]: WARNING nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-f2b9f7ee-3832-401a-b4c0-4620bfed1148 for instance with vm_state active and task_state deleting.
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-unplugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-unplugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-plugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Acquiring lock "f867644d-af12-4b8b-be06-ff6c00344095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] Lock "f867644d-af12-4b8b-be06-ff6c00344095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] No waiting events found dispatching network-vif-plugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:45 user nova-compute[75239]: WARNING nova.compute.manager [req-95040cf6-7fb0-49ff-b456-74d1fe060fa9 req-33b45cae-e9a8-4e16-b4a9-6152c4b00a5c service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received unexpected event network-vif-plugged-b79d0880-dc18-45b3-ad95-09fd3ff58395 for instance with vm_state active and task_state deleting.
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe651bc-3d8a-4bd2-b524-439927eef12e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47db1b8-74d5-4596-a1b3-f92bb5c02fa6]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] SCSI volumes sdh have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7d2bdb-2b03-4733-9fe9-3a55695ff5be]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd7cd0e-7045-45f4-9dcd-31ecff8a694e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b, portal: 172.16.0.220,3260]
Nov 13 20:39:45 user nova-compute[75239]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b, portal: 172.16.0.220,3260] successful.
Nov 13 20:39:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdceccf9-b81f-4c8e-86a5-494b5b51ae7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7715fc2a-2201-4e0b-83e6-759872c54cb6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] <== disconnect_volume: return (390ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:39:45 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Deleting instance files /opt/stack/data/nova/instances/f867644d-af12-4b8b-be06-ff6c00344095_del
Nov 13 20:39:45 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Deletion of /opt/stack/data/nova/instances/f867644d-af12-4b8b-be06-ff6c00344095_del complete
Nov 13 20:39:45 user nova-compute[75239]: INFO nova.compute.manager [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Took 3.89 seconds to destroy the instance on the hypervisor.
Nov 13 20:39:45 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: f867644d-af12-4b8b-be06-ff6c00344095] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:46 user nova-compute[75239]: DEBUG nova.compute.manager [req-235a225f-29bb-4262-971f-ef6d6dd2e422 req-a1ef84a0-e1aa-4563-ac24-46f92e9f6855 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-235a225f-29bb-4262-971f-ef6d6dd2e422 req-a1ef84a0-e1aa-4563-ac24-46f92e9f6855 service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-235a225f-29bb-4262-971f-ef6d6dd2e422 req-a1ef84a0-e1aa-4563-ac24-46f92e9f6855 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-235a225f-29bb-4262-971f-ef6d6dd2e422 req-a1ef84a0-e1aa-4563-ac24-46f92e9f6855 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:46 user nova-compute[75239]: DEBUG nova.compute.manager [req-235a225f-29bb-4262-971f-ef6d6dd2e422 req-a1ef84a0-e1aa-4563-ac24-46f92e9f6855 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:46 user nova-compute[75239]: WARNING nova.compute.manager [req-235a225f-29bb-4262-971f-ef6d6dd2e422 req-a1ef84a0-e1aa-4563-ac24-46f92e9f6855 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state building and task_state spawning.
Nov 13 20:39:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-2b2102d9-ad89-4784-a5b0-4fd7c6f488ad req-af8d6b97-28bb-49df-b091-7c49aef3fe90 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-deleted-77d1bec8-0075-42a5-ae4c-85e20523b131 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:47 user nova-compute[75239]: INFO nova.compute.manager [req-2b2102d9-ad89-4784-a5b0-4fd7c6f488ad req-af8d6b97-28bb-49df-b091-7c49aef3fe90 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Neutron deleted interface 77d1bec8-0075-42a5-ae4c-85e20523b131; detaching it from the instance and deleting it from the info cache
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-2b2102d9-ad89-4784-a5b0-4fd7c6f488ad req-af8d6b97-28bb-49df-b091-7c49aef3fe90 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [{"id": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "address": "fa:16:3e:f9:af:00", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2b9f7ee-38", "ovs_interfaceid": "f2b9f7ee-3832-401a-b4c0-4620bfed1148", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "address": "fa:16:3e:8b:7d:1d", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb79d0880-dc", "ovs_interfaceid": "b79d0880-dc18-45b3-ad95-09fd3ff58395", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "address": "fa:16:3e:62:7f:5f", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap200b2855-5a", "ovs_interfaceid": "200b2855-5a4a-4ef4-b4d2-a3328f7d8637", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "address": "fa:16:3e:61:71:89", "network": {"id": "bf5fad07-c66f-4019-8287-008b3649ca01", "bridge": "br-int", "label": "tempest-device-tagging-net1-866813723", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92b00a74-9a", "ovs_interfaceid": "92b00a74-9a51-477d-8010-e2f86e1cabbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "address": "fa:16:3e:56:9f:95", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42a122d2-f1", "ovs_interfaceid": "42a122d2-f18d-46a5-9b9b-fb60602bfe82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "address": "fa:16:3e:89:29:52", "network": {"id": "102ee64c-2724-4b64-9853-b34dd9c48950", "bridge": "br-int", "label": "tempest-device-tagging-net2-1862756525", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "cee07325ee534b3a92cb18de0fc6a748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7ccc5fa-9e", "ovs_interfaceid": "f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-2b2102d9-ad89-4784-a5b0-4fd7c6f488ad req-af8d6b97-28bb-49df-b091-7c49aef3fe90 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Detach interface failed, port_id=77d1bec8-0075-42a5-ae4c-85e20523b131, reason: Instance f867644d-af12-4b8b-be06-ff6c00344095 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:39:47 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance spawned successfully.
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:39:48 user nova-compute[75239]: INFO nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 13 20:39:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-04fca586-9957-4e94-ada7-2f8ead8cd927 req-d73c9d35-7426-496e-aeaa-b51b25f977e6 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-04fca586-9957-4e94-ada7-2f8ead8cd927 req-d73c9d35-7426-496e-aeaa-b51b25f977e6 service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-04fca586-9957-4e94-ada7-2f8ead8cd927 req-d73c9d35-7426-496e-aeaa-b51b25f977e6 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-04fca586-9957-4e94-ada7-2f8ead8cd927 req-d73c9d35-7426-496e-aeaa-b51b25f977e6 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-04fca586-9957-4e94-ada7-2f8ead8cd927 req-d73c9d35-7426-496e-aeaa-b51b25f977e6 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:48 user nova-compute[75239]: WARNING nova.compute.manager [req-04fca586-9957-4e94-ada7-2f8ead8cd927 req-d73c9d35-7426-496e-aeaa-b51b25f977e6 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state building and task_state spawning.
Nov 13 20:39:48 user nova-compute[75239]: INFO nova.compute.manager [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Took 7.38 seconds to build instance.
Nov 13 20:39:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-139a3fd2-8a0e-48e7-bc5b-c1d13bb6655a tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.477s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:48 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Took 3.31 seconds to deallocate network for instance.
Nov 13 20:39:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:48 user nova-compute[75239]: INFO nova.compute.manager [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Terminating instance
Nov 13 20:39:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-fdb4d999-2b4f-4876-97bc-25b63c335d6e req-e1c47ba7-64d8-4f09-9117-2d50c3b28a96 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-unplugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fdb4d999-2b4f-4876-97bc-25b63c335d6e req-e1c47ba7-64d8-4f09-9117-2d50c3b28a96 service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fdb4d999-2b4f-4876-97bc-25b63c335d6e req-e1c47ba7-64d8-4f09-9117-2d50c3b28a96 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fdb4d999-2b4f-4876-97bc-25b63c335d6e req-e1c47ba7-64d8-4f09-9117-2d50c3b28a96 service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-fdb4d999-2b4f-4876-97bc-25b63c335d6e req-e1c47ba7-64d8-4f09-9117-2d50c3b28a96 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-unplugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-fdb4d999-2b4f-4876-97bc-25b63c335d6e req-e1c47ba7-64d8-4f09-9117-2d50c3b28a96 service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-unplugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-38f76ccb-b76d-4e21-85fe-24fcf5dd1966 req-bce3e9fd-be7f-4b59-8053-4f20643d9c74 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-deleted-200b2855-5a4a-4ef4-b4d2-a3328f7d8637 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-38f76ccb-b76d-4e21-85fe-24fcf5dd1966 req-bce3e9fd-be7f-4b59-8053-4f20643d9c74 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-deleted-92b00a74-9a51-477d-8010-e2f86e1cabbf {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-38f76ccb-b76d-4e21-85fe-24fcf5dd1966 req-bce3e9fd-be7f-4b59-8053-4f20643d9c74 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-deleted-f7ccc5fa-9e83-4e2c-ac2b-5e59c716a3c7 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-38f76ccb-b76d-4e21-85fe-24fcf5dd1966 req-bce3e9fd-be7f-4b59-8053-4f20643d9c74 service nova] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Received event network-vif-deleted-42a122d2-f18d-46a5-9b9b-fb60602bfe82 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Instance destroyed successfully.
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.objects.instance [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lazy-loading 'resources' on Instance uuid d67fcb6b-fb37-4d04-8dab-d74370f76981 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-616704806',display_name='tempest-ServerStableDeviceRescueTest-server-616704806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-616704806',id=5,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNyr6IAcaCWhTnd0M31N5isR2JfZGlfnnpnSCe2iTutyciIj40lB+x3H5rvcMVdsmn5oFtO37aMp9V7yFAx+Kfzowav3xLguTou77n7NO1lviCmuoo+BE+hwWUoq0BqMA==',key_name='tempest-keypair-2109943276',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:36:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce07a49816064edfbf14f89b5895e9e5',ramdisk_id='',reservation_id='r-hbacdswg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-456666962',owner_user_name='tempest-ServerStableDeviceRescueTest-456666962-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='66625adc0c8d4508987cc570c5ae3b32',uuid=d67fcb6b-fb37-4d04-8dab-d74370f76981,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Converting VIF {"id": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "address": "fa:16:3e:64:63:b2", "network": {"id": "44e91adc-ee33-4228-8854-2883d4950214", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1341073364-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce07a49816064edfbf14f89b5895e9e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e91bea0-de", "ovs_interfaceid": "8e91bea0-dea9-49f6-ac95-f485a29d5cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:63:b2,bridge_name='br-int',has_traffic_filtering=True,id=8e91bea0-dea9-49f6-ac95-f485a29d5cd2,network=Network(44e91adc-ee33-4228-8854-2883d4950214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e91bea0-de') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG os_vif [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:63:b2,bridge_name='br-int',has_traffic_filtering=True,id=8e91bea0-dea9-49f6-ac95-f485a29d5cd2,network=Network(44e91adc-ee33-4228-8854-2883d4950214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e91bea0-de') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e91bea0-de, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c7f83ed-bcfc-4dfd-bc47-cfa543b432aa) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:49 user nova-compute[75239]: INFO os_vif [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:63:b2,bridge_name='br-int',has_traffic_filtering=True,id=8e91bea0-dea9-49f6-ac95-f485a29d5cd2,network=Network(44e91adc-ee33-4228-8854-2883d4950214),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e91bea0-de')
Nov 13 20:39:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Deleting instance files /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981_del
Nov 13 20:39:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Deletion of /opt/stack/data/nova/instances/d67fcb6b-fb37-4d04-8dab-d74370f76981_del complete
Nov 13 20:39:49 user nova-compute[75239]: INFO nova.compute.manager [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 13 20:39:49 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:39:49 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:39:50 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:39:50 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Took 1.00 seconds to deallocate network for instance.
Nov 13 20:39:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-c72e7e9c-f0f3-4519-a52a-93cbaf422d27 req-77d0f995-82f0-4dc6-8a98-78737ed0ae7e service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c72e7e9c-f0f3-4519-a52a-93cbaf422d27 req-77d0f995-82f0-4dc6-8a98-78737ed0ae7e service nova] Acquiring lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c72e7e9c-f0f3-4519-a52a-93cbaf422d27 req-77d0f995-82f0-4dc6-8a98-78737ed0ae7e service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c72e7e9c-f0f3-4519-a52a-93cbaf422d27 req-77d0f995-82f0-4dc6-8a98-78737ed0ae7e service nova] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-c72e7e9c-f0f3-4519-a52a-93cbaf422d27 req-77d0f995-82f0-4dc6-8a98-78737ed0ae7e service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] No waiting events found dispatching network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:39:51 user nova-compute[75239]: WARNING nova.compute.manager [req-c72e7e9c-f0f3-4519-a52a-93cbaf422d27 req-77d0f995-82f0-4dc6-8a98-78737ed0ae7e service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received unexpected event network-vif-plugged-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 for instance with vm_state deleted and task_state None.
Nov 13 20:39:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-29beb7b5-dd13-4046-b06c-611443c595fb req-28a4c733-56cc-4621-8ff1-20b96d8dcf9f service nova] [instance: d67fcb6b-fb37-4d04-8dab-d74370f76981] Received event network-vif-deleted-8e91bea0-dea9-49f6-ac95-f485a29d5cd2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:39:51 user nova-compute[75239]: INFO nova.compute.manager [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] [instance: f867644d-af12-4b8b-be06-ff6c00344095] Took 2.85 seconds to detach 3 volumes for instance.
Nov 13 20:39:51 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Deleted allocations for instance d67fcb6b-fb37-4d04-8dab-d74370f76981
Nov 13 20:39:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-77e38f53-bfa5-4df2-b9eb-c1cdd87c3024 tempest-ServerStableDeviceRescueTest-456666962 tempest-ServerStableDeviceRescueTest-456666962-project-member] Lock "d67fcb6b-fb37-4d04-8dab-d74370f76981" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.649s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:39:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:39:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:52 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Deleted allocations for instance f867644d-af12-4b8b-be06-ff6c00344095
Nov 13 20:39:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36818454-cfca-47be-b5df-2ffb27346cd8 tempest-TaggedBootDevicesTest_v242-1283413932 tempest-TaggedBootDevicesTest_v242-1283413932-project-member] Lock "f867644d-af12-4b8b-be06-ff6c00344095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.691s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:39:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:39:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:00 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc is timed out.
Nov 13 20:40:00 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Successfully detached device vdb from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc from the live domain config.
Nov 13 20:40:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:40:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nawjkFPW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:40:00 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:40:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:40:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:40:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bffe564-52bf-48a8-813e-430439fc2e1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:40:00 user nova-compute[75239]: No targets found.
Nov 13 20:40:00 user nova-compute[75239]: iSNS:
Nov 13 20:40:00 user nova-compute[75239]: No targets found.
Nov 13 20:40:00 user nova-compute[75239]: STATIC:
Nov 13 20:40:00 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:40:00 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:40:00 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:40:00 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:40:00 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:40:00 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:40:00 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96
Nov 13 20:40:00 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:40:00 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:40:00 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:40:00 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:40:00 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:40:00 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc
Nov 13 20:40:00 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:40:00 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:40:00 user nova-compute[75239]: FIRMWARE:
Nov 13 20:40:00 user nova-compute[75239]: No targets found.
Nov 13 20:40:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:40:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:40:00 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:40:00 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:40:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:40:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf628da-53c2-400d-b515-f1ac849256ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9202a533-7f9d-4e21-9cf1-cec484ee2ab0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:40:01 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:40:01 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:40:01 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:40:01 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:40:01 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:40:01 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:40:01 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:40:01 user nova-compute[75239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 (non-flash)
Nov 13 20:40:01 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:40:01 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60417640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96'): ({'sdd'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Removing single pathed devices sdd {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c25d0e-71da-404d-b600-1fd56bdb920f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad89c9fe-fcf0-435f-bb05-7aa22a2dd1cd]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Flushing IO for device /dev/sdd {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5afe1e7-9f5a-4bda-a104-9c7008dfa742]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7331b5c-5f90-4ec4-9d4f-94a870489ab1]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[65037550-d89f-40bc-b903-ca4cad2d272f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.125s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c391ab-1e29-4cdd-8266-47ff4f35c66b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96, portal: 172.16.0.220,3260]
Nov 13 20:40:01 user nova-compute[75239]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96, portal: 172.16.0.220,3260] successful.
Nov 13 20:40:01 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61e4725e-01d4-4eb8-8dd9-f73536a7db96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fbdfb1-a0ae-47a8-b424-e241cf27fded]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] <== disconnect_volume: return (411ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:40:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lazy-loading 'flavor' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-48dd4a3c-5a1b-4cf8-a546-e29a77e38cab tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.011s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "interface-fcafe860-22f2-4e7f-b1fc-d515c81762bc-739b2b46-cd07-45c8-bca5-5d36c8c744b1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "interface-fcafe860-22f2-4e7f-b1fc-d515c81762bc-739b2b46-cd07-45c8-bca5-5d36c8c744b1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lazy-loading 'flavor' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328986222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328986222',id=20,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzePX1hT2woml8vSrOF8vsehzyoQyDIDpKzXNnSV7g611OdghErTyj7yzdlaSTAX9UCgl8tKvGNN0b/Ma50TAXHkeoKbz087TbCFE625mSyZ4RbQrLqedGEnT1H3VPyVA==',key_name='tempest-keypair-989254085',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fffa6e76e666484b8d3d4b66d58c1898',ramdisk_id='',reservation_id='r-fektjpro',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2035153286',owner_user_name='tempest-TaggedAttachmentsTest-2035153286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276cb9cf493a47a0a8a4ea045e3277c4',uuid=fcafe860-22f2-4e7f-b1fc-d515c81762bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converting VIF {"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface> {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface> {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Attempting to detach device tap739b2b46-cd from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] detach device xml: <interface type="ethernet">
Nov 13 20:40:02 user nova-compute[75239]:   <mac address="fa:16:3e:b2:3a:2f"/>
Nov 13 20:40:02 user nova-compute[75239]:   <model type="virtio"/>
Nov 13 20:40:02 user nova-compute[75239]:   <mtu size="1442"/>
Nov 13 20:40:02 user nova-compute[75239]:   <target dev="tap739b2b46-cd"/>
Nov 13 20:40:02 user nova-compute[75239]: </interface>
Nov 13 20:40:02 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface> {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface>not found in domain: <domain type='kvm' id='23'>
Nov 13 20:40:02 user nova-compute[75239]:   <name>instance-00000014</name>
Nov 13 20:40:02 user nova-compute[75239]:   <uuid>fcafe860-22f2-4e7f-b1fc-d515c81762bc</uuid>
Nov 13 20:40:02 user nova-compute[75239]:   <metadata>
Nov 13 20:40:02 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:40:02 user nova-compute[75239]:   <nova:package version="0.0.0"/>
Nov 13 20:40:02 user nova-compute[75239]:   <nova:name>tempest-device-tagging-server-1328986222</nova:name>
Nov 13 20:40:02 user nova-compute[75239]:   <nova:creationTime>2023-11-13 20:39:30</nova:creationTime>
Nov 13 20:40:02 user nova-compute[75239]:   <nova:flavor name="m1.tiny">
Nov 13 20:40:02 user nova-compute[75239]:     <nova:memory>512</nova:memory>
Nov 13 20:40:02 user nova-compute[75239]:     <nova:disk>1</nova:disk>
Nov 13 20:40:02 user nova-compute[75239]:     <nova:swap>0</nova:swap>
Nov 13 20:40:02 user nova-compute[75239]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:40:02 user nova-compute[75239]:     <nova:vcpus>1</nova:vcpus>
Nov 13 20:40:02 user nova-compute[75239]:   </nova:flavor>
Nov 13 20:40:02 user nova-compute[75239]:   <nova:owner>
Nov 13 20:40:02 user nova-compute[75239]:     <nova:user uuid="276cb9cf493a47a0a8a4ea045e3277c4">tempest-TaggedAttachmentsTest-2035153286-project-member</nova:user>
Nov 13 20:40:02 user nova-compute[75239]:     <nova:project uuid="fffa6e76e666484b8d3d4b66d58c1898">tempest-TaggedAttachmentsTest-2035153286</nova:project>
Nov 13 20:40:02 user nova-compute[75239]:   </nova:owner>
Nov 13 20:40:02 user nova-compute[75239]:   <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:40:02 user nova-compute[75239]:   <nova:ports>
Nov 13 20:40:02 user nova-compute[75239]:     <nova:port uuid="a8636abe-8a8c-471f-add4-dbec8745a4a4">
Nov 13 20:40:02 user nova-compute[75239]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:40:02 user nova-compute[75239]:     </nova:port>
Nov 13 20:40:02 user nova-compute[75239]:     <nova:port uuid="739b2b46-cd07-45c8-bca5-5d36c8c744b1">
Nov 13 20:40:02 user nova-compute[75239]:       <nova:ip type="fixed" address="10.10.10.41" ipVersion="4"/>
Nov 13 20:40:02 user nova-compute[75239]:     </nova:port>
Nov 13 20:40:02 user nova-compute[75239]:   </nova:ports>
Nov 13 20:40:02 user nova-compute[75239]: </nova:instance>
Nov 13 20:40:02 user nova-compute[75239]:   </metadata>
Nov 13 20:40:02 user nova-compute[75239]:   <memory unit='KiB'>524288</memory>
Nov 13 20:40:02 user nova-compute[75239]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 20:40:02 user nova-compute[75239]:   <vcpu placement='static'>1</vcpu>
Nov 13 20:40:02 user nova-compute[75239]:   <resource>
Nov 13 20:40:02 user nova-compute[75239]:     <partition>/machine</partition>
Nov 13 20:40:02 user nova-compute[75239]:   </resource>
Nov 13 20:40:02 user nova-compute[75239]:   <sysinfo type='smbios'>
Nov 13 20:40:02 user nova-compute[75239]:     <system>
Nov 13 20:40:02 user nova-compute[75239]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 20:40:02 user nova-compute[75239]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 20:40:02 user nova-compute[75239]:       <entry name='version'>0.0.0</entry>
Nov 13 20:40:02 user nova-compute[75239]:       <entry name='serial'>fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:40:02 user nova-compute[75239]:       <entry name='uuid'>fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:40:02 user nova-compute[75239]:       <entry name='family'>Virtual Machine</entry>
Nov 13 20:40:02 user nova-compute[75239]:     </system>
Nov 13 20:40:02 user nova-compute[75239]:   </sysinfo>
Nov 13 20:40:02 user nova-compute[75239]:   <os>
Nov 13 20:40:02 user nova-compute[75239]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 20:40:02 user nova-compute[75239]:     <boot dev='hd'/>
Nov 13 20:40:02 user nova-compute[75239]:     <smbios mode='sysinfo'/>
Nov 13 20:40:02 user nova-compute[75239]:   </os>
Nov 13 20:40:02 user nova-compute[75239]:   <features>
Nov 13 20:40:02 user nova-compute[75239]:     <acpi/>
Nov 13 20:40:02 user nova-compute[75239]:     <apic/>
Nov 13 20:40:02 user nova-compute[75239]:     <vmcoreinfo state='on'/>
Nov 13 20:40:02 user nova-compute[75239]:   </features>
Nov 13 20:40:02 user nova-compute[75239]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 20:40:02 user nova-compute[75239]:     <model fallback='forbid'>Nehalem</model>
Nov 13 20:40:02 user nova-compute[75239]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 20:40:02 user nova-compute[75239]:     <feature policy='require' name='vme'/>
Nov 13 20:40:02 user nova-compute[75239]:     <feature policy='require' name='x2apic'/>
Nov 13 20:40:02 user nova-compute[75239]:     <feature policy='require' name='hypervisor'/>
Nov 13 20:40:02 user nova-compute[75239]:   </cpu>
Nov 13 20:40:02 user nova-compute[75239]:   <clock offset='utc'>
Nov 13 20:40:02 user nova-compute[75239]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 20:40:02 user nova-compute[75239]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 20:40:02 user nova-compute[75239]:     <timer name='hpet' present='no'/>
Nov 13 20:40:02 user nova-compute[75239]:   </clock>
Nov 13 20:40:02 user nova-compute[75239]:   <on_poweroff>destroy</on_poweroff>
Nov 13 20:40:02 user nova-compute[75239]:   <on_reboot>restart</on_reboot>
Nov 13 20:40:02 user nova-compute[75239]:   <on_crash>destroy</on_crash>
Nov 13 20:40:02 user nova-compute[75239]:   <devices>
Nov 13 20:40:02 user nova-compute[75239]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 20:40:02 user nova-compute[75239]:     <disk type='file' device='disk'>
Nov 13 20:40:02 user nova-compute[75239]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 20:40:02 user nova-compute[75239]:       <source file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk' index='2'/>
Nov 13 20:40:02 user nova-compute[75239]:       <backingStore type='file' index='3'>
Nov 13 20:40:02 user nova-compute[75239]:         <format type='raw'/>
Nov 13 20:40:02 user nova-compute[75239]:         <source file='/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79'/>
Nov 13 20:40:02 user nova-compute[75239]:         <backingStore/>
Nov 13 20:40:02 user nova-compute[75239]:       </backingStore>
Nov 13 20:40:02 user nova-compute[75239]:       <target dev='vda' bus='virtio'/>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='virtio-disk0'/>
Nov 13 20:40:02 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </disk>
Nov 13 20:40:02 user nova-compute[75239]:     <disk type='file' device='cdrom'>
Nov 13 20:40:02 user nova-compute[75239]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 20:40:02 user nova-compute[75239]:       <source file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.config' index='1'/>
Nov 13 20:40:02 user nova-compute[75239]:       <backingStore/>
Nov 13 20:40:02 user nova-compute[75239]:       <target dev='hda' bus='ide'/>
Nov 13 20:40:02 user nova-compute[75239]:       <readonly/>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='ide0-0-0'/>
Nov 13 20:40:02 user nova-compute[75239]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </disk>
Nov 13 20:40:02 user nova-compute[75239]:     <controller type='usb' index='0' model='none'>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='usb'/>
Nov 13 20:40:02 user nova-compute[75239]:     </controller>
Nov 13 20:40:02 user nova-compute[75239]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='pci.0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </controller>
Nov 13 20:40:02 user nova-compute[75239]:     <controller type='ide' index='0'>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='ide'/>
Nov 13 20:40:02 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 20:40:02 user nova-compute[75239]:     </controller>
Nov 13 20:40:02 user nova-compute[75239]:     <interface type='ethernet'>
Nov 13 20:40:02 user nova-compute[75239]:       <mac address='fa:16:3e:8e:01:3d'/>
Nov 13 20:40:02 user nova-compute[75239]:       <target dev='tapa8636abe-8a'/>
Nov 13 20:40:02 user nova-compute[75239]:       <model type='virtio'/>
Nov 13 20:40:02 user nova-compute[75239]:       <mtu size='1442'/>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='net0'/>
Nov 13 20:40:02 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </interface>
Nov 13 20:40:02 user nova-compute[75239]:     <interface type='ethernet'>
Nov 13 20:40:02 user nova-compute[75239]:       <mac address='fa:16:3e:b2:3a:2f'/>
Nov 13 20:40:02 user nova-compute[75239]:       <target dev='tap739b2b46-cd'/>
Nov 13 20:40:02 user nova-compute[75239]:       <model type='virtio'/>
Nov 13 20:40:02 user nova-compute[75239]:       <mtu size='1442'/>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='net1'/>
Nov 13 20:40:02 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </interface>
Nov 13 20:40:02 user nova-compute[75239]:     <serial type='pty'>
Nov 13 20:40:02 user nova-compute[75239]:       <source path='/dev/pts/2'/>
Nov 13 20:40:02 user nova-compute[75239]:       <log file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log' append='off'/>
Nov 13 20:40:02 user nova-compute[75239]:       <target type='isa-serial' port='0'>
Nov 13 20:40:02 user nova-compute[75239]:         <model name='isa-serial'/>
Nov 13 20:40:02 user nova-compute[75239]:       </target>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='serial0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </serial>
Nov 13 20:40:02 user nova-compute[75239]:     <console type='pty' tty='/dev/pts/2'>
Nov 13 20:40:02 user nova-compute[75239]:       <source path='/dev/pts/2'/>
Nov 13 20:40:02 user nova-compute[75239]:       <log file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log' append='off'/>
Nov 13 20:40:02 user nova-compute[75239]:       <target type='serial' port='0'/>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='serial0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </console>
Nov 13 20:40:02 user nova-compute[75239]:     <input type='mouse' bus='ps2'>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='input0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </input>
Nov 13 20:40:02 user nova-compute[75239]:     <input type='keyboard' bus='ps2'>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='input1'/>
Nov 13 20:40:02 user nova-compute[75239]:     </input>
Nov 13 20:40:02 user nova-compute[75239]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 13 20:40:02 user nova-compute[75239]:       <listen type='address' address='0.0.0.0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </graphics>
Nov 13 20:40:02 user nova-compute[75239]:     <audio id='1' type='none'/>
Nov 13 20:40:02 user nova-compute[75239]:     <video>
Nov 13 20:40:02 user nova-compute[75239]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='video0'/>
Nov 13 20:40:02 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </video>
Nov 13 20:40:02 user nova-compute[75239]:     <memballoon model='virtio'>
Nov 13 20:40:02 user nova-compute[75239]:       <stats period='10'/>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='balloon0'/>
Nov 13 20:40:02 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </memballoon>
Nov 13 20:40:02 user nova-compute[75239]:     <rng model='virtio'>
Nov 13 20:40:02 user nova-compute[75239]:       <backend model='random'>/dev/urandom</backend>
Nov 13 20:40:02 user nova-compute[75239]:       <alias name='rng0'/>
Nov 13 20:40:02 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 20:40:02 user nova-compute[75239]:     </rng>
Nov 13 20:40:02 user nova-compute[75239]:   </devices>
Nov 13 20:40:02 user nova-compute[75239]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 20:40:02 user nova-compute[75239]:     <label>libvirt-fcafe860-22f2-4e7f-b1fc-d515c81762bc</label>
Nov 13 20:40:02 user nova-compute[75239]:     <imagelabel>libvirt-fcafe860-22f2-4e7f-b1fc-d515c81762bc</imagelabel>
Nov 13 20:40:02 user nova-compute[75239]:   </seclabel>
Nov 13 20:40:02 user nova-compute[75239]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 20:40:02 user nova-compute[75239]:     <label>+64055:+108</label>
Nov 13 20:40:02 user nova-compute[75239]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 20:40:02 user nova-compute[75239]:   </seclabel>
Nov 13 20:40:02 user nova-compute[75239]: </domain>
Nov 13 20:40:02 user nova-compute[75239]:  {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 20:40:02 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Successfully detached device tap739b2b46-cd from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc from the persistent domain config.
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] (1/8): Attempting to detach device tap739b2b46-cd with device alias net1 from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:40:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] detach device xml: <interface type="ethernet">
Nov 13 20:40:02 user nova-compute[75239]:   <mac address="fa:16:3e:b2:3a:2f"/>
Nov 13 20:40:02 user nova-compute[75239]:   <model type="virtio"/>
Nov 13 20:40:02 user nova-compute[75239]:   <mtu size="1442"/>
Nov 13 20:40:02 user nova-compute[75239]:   <target dev="tap739b2b46-cd"/>
Nov 13 20:40:02 user nova-compute[75239]: </interface>
Nov 13 20:40:02 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Start waiting for the detach event from libvirt for device tap739b2b46-cd with device alias net1 for instance fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-40f62496-7ded-4bf0-9f72-421275ec89b7 req-7995af16-bf78-4b23-94ee-b184345fa897 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-unplugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-40f62496-7ded-4bf0-9f72-421275ec89b7 req-7995af16-bf78-4b23-94ee-b184345fa897 service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-40f62496-7ded-4bf0-9f72-421275ec89b7 req-7995af16-bf78-4b23-94ee-b184345fa897 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-40f62496-7ded-4bf0-9f72-421275ec89b7 req-7995af16-bf78-4b23-94ee-b184345fa897 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-40f62496-7ded-4bf0-9f72-421275ec89b7 req-7995af16-bf78-4b23-94ee-b184345fa897 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-unplugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:03 user nova-compute[75239]: WARNING nova.compute.manager [req-40f62496-7ded-4bf0-9f72-421275ec89b7 req-7995af16-bf78-4b23-94ee-b184345fa897 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-unplugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 for instance with vm_state active and task_state None.
Nov 13 20:40:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-c0e7e4ac-8962-4050-b434-3b1cd284141d req-5733e490-5b86-4a54-85cf-d6f7d2757a0c service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-plugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c0e7e4ac-8962-4050-b434-3b1cd284141d req-5733e490-5b86-4a54-85cf-d6f7d2757a0c service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c0e7e4ac-8962-4050-b434-3b1cd284141d req-5733e490-5b86-4a54-85cf-d6f7d2757a0c service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c0e7e4ac-8962-4050-b434-3b1cd284141d req-5733e490-5b86-4a54-85cf-d6f7d2757a0c service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-c0e7e4ac-8962-4050-b434-3b1cd284141d req-5733e490-5b86-4a54-85cf-d6f7d2757a0c service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-plugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:05 user nova-compute[75239]: WARNING nova.compute.manager [req-c0e7e4ac-8962-4050-b434-3b1cd284141d req-5733e490-5b86-4a54-85cf-d6f7d2757a0c service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-plugged-739b2b46-cd07-45c8-bca5-5d36c8c744b1 for instance with vm_state active and task_state None.
Nov 13 20:40:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:14 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:40:14 user nova-compute[75239]: INFO nova.compute.manager [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] instance snapshotting
Nov 13 20:40:14 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Beginning live snapshot process
Nov 13 20:40:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json -f qcow2 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json -f qcow2 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json -f qcow2" returned: 0 in 0.166s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwptwdxkl/ec937781801e4b24b30b9304ac4eea31.delta 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpwptwdxkl/ec937781801e4b24b30b9304ac4eea31.delta 1073741824" returned: 0 in 0.045s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:15 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 20:40:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:40:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:40:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 20:40:16 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:40:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwptwdxkl/ec937781801e4b24b30b9304ac4eea31.delta /opt/stack/data/nova/instances/snapshots/tmpwptwdxkl/ec937781801e4b24b30b9304ac4eea31 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpwptwdxkl/ec937781801e4b24b30b9304ac4eea31.delta /opt/stack/data/nova/instances/snapshots/tmpwptwdxkl/ec937781801e4b24b30b9304ac4eea31" returned: 0 in 0.330s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:17 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Snapshot extracted, beginning image upload
Nov 13 20:40:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:19 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Snapshot image upload complete
Nov 13 20:40:19 user nova-compute[75239]: INFO nova.compute.manager [None req-a906a0b6-a2d0-40cc-a9ce-e2aeb3793e8c tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Took 4.91 seconds to snapshot the instance on the hypervisor.
Nov 13 20:40:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:21 user nova-compute[75239]: INFO nova.compute.manager [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Terminating instance
Nov 13 20:40:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-57d125ed-1e30-4a6a-bfeb-cb98827b9b7a req-9f970072-e7e1-4a44-a3a4-b002779d6a48 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-unplugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-57d125ed-1e30-4a6a-bfeb-cb98827b9b7a req-9f970072-e7e1-4a44-a3a4-b002779d6a48 service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-57d125ed-1e30-4a6a-bfeb-cb98827b9b7a req-9f970072-e7e1-4a44-a3a4-b002779d6a48 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-57d125ed-1e30-4a6a-bfeb-cb98827b9b7a req-9f970072-e7e1-4a44-a3a4-b002779d6a48 service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-57d125ed-1e30-4a6a-bfeb-cb98827b9b7a req-9f970072-e7e1-4a44-a3a4-b002779d6a48 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-unplugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-57d125ed-1e30-4a6a-bfeb-cb98827b9b7a req-9f970072-e7e1-4a44-a3a4-b002779d6a48 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-unplugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:21 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:40:21 user nova-compute[75239]: INFO nova.compute.claims [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Claim successful on node user
Nov 13 20:40:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Instance destroyed successfully.
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lazy-loading 'resources' on Instance uuid 1fe94db5-cf69-4e80-a779-e2182588ab56 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-364989443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-80459434',id=16,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4bTkMByBBN86gQLJ0njqwBvWR0XDRjrFeM5rsfRs/jEsAUVgdGRCe/qEZj7jheAmcMs60nSNIENVVJ15Le3mNrjiOZ1ooTGgvR6HWSRyk2+0hsYobO++zcjvL8uksDpg==',key_name='tempest-keypair-1832288825',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:39:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='100038f3462149338c8baaefb89970e5',ramdisk_id='',reservation_id='r-cyw07hcq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-403999266',owner_user_name='tempest-ServerActionsV293TestJSON-403999266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0adecc32b22a4d7a910320d9f6c4f2ee',uuid=1fe94db5-cf69-4e80-a779-e2182588ab56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converting VIF {"id": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "address": "fa:16:3e:a4:19:fe", "network": {"id": "dde7013f-46d0-40f6-aaa6-ee4b587ccf57", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-137852192-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "100038f3462149338c8baaefb89970e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37dadfef-e9", "ovs_interfaceid": "37dadfef-e9b8-45fe-a9f2-901e412a21d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_vif [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37dadfef-e9, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=048dcf23-b3f6-47c2-93fc-cdb287b7fe59) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:22 user nova-compute[75239]: INFO os_vif [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:19:fe,bridge_name='br-int',has_traffic_filtering=True,id=37dadfef-e9b8-45fe-a9f2-901e412a21d0,network=Network(dde7013f-46d0-40f6-aaa6-ee4b587ccf57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37dadfef-e9')
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EzyCURQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:40:22 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[567b625f-d34f-48d2-ab2a-f828254fefae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:40:22 user nova-compute[75239]: No targets found.
Nov 13 20:40:22 user nova-compute[75239]: iSNS:
Nov 13 20:40:22 user nova-compute[75239]: No targets found.
Nov 13 20:40:22 user nova-compute[75239]: STATIC:
Nov 13 20:40:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:40:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:40:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:40:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:40:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:40:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:40:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f
Nov 13 20:40:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:40:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:40:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc
Nov 13 20:40:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:40:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:40:22 user nova-compute[75239]: FIRMWARE:
Nov 13 20:40:22 user nova-compute[75239]: No targets found.
Nov 13 20:40:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:40:22 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:40:22 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fadb10-e176-4e47-8cdf-1bd6d7c0b2ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c4cb21-73bc-4d29-b799-413835aca846]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:40:22 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:40:22 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:40:22 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:40:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:40:22 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:40:22 user nova-compute[75239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f (non-flash)
Nov 13 20:40:22 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:40:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605d3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e308e5c2-12c6-4f3c-b755-74738f0a5e8c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43fd1e2-f143-4cb9-a2c0-e9f1bf5cad27]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.network.neutron [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67674eca-d9b3-4286-91f2-1127aa7ae60d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:40:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[051ac64a-07f4-4d4c-941e-ecb0a26ba1db]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.policy [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '297728d5d4c4454a9f9acd594d24b232', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd292feb205994cddb6f2765da53fee90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[316bf39c-1ef6-4c2a-9586-7d77937ed723]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa1bf3e-dab1-48f1-910e-f6eb2a931fd5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260]
Nov 13 20:40:22 user nova-compute[75239]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f, portal: 172.16.0.220,3260] successful.
Nov 13 20:40:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:40:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Creating image(s)
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "/opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "/opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "1262e370fd64eaf3df14ee84eb577c607d631afa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1262e370fd64eaf3df14ee84eb577c607d631afa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1faa23e0-a730-43ba-9425-eca3b7105d2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c9e1bd-ad66-4644-bf9f-e0afd90de48f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] <== disconnect_volume: return (324ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:40:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Deleting instance files /opt/stack/data/nova/instances/1fe94db5-cf69-4e80-a779-e2182588ab56_del
Nov 13 20:40:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Deletion of /opt/stack/data/nova/instances/1fe94db5-cf69-4e80-a779-e2182588ab56_del complete
Nov 13 20:40:22 user nova-compute[75239]: INFO nova.compute.manager [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 13 20:40:22 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:40:22 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:23 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Waiting for libvirt event about the detach of device tap739b2b46-cd with device alias net1 from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc is timed out.
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface> {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.network.neutron [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Successfully created port: 8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface>not found in domain: <domain type='kvm' id='23'>
Nov 13 20:40:23 user nova-compute[75239]:   <name>instance-00000014</name>
Nov 13 20:40:23 user nova-compute[75239]:   <uuid>fcafe860-22f2-4e7f-b1fc-d515c81762bc</uuid>
Nov 13 20:40:23 user nova-compute[75239]:   <metadata>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:40:23 user nova-compute[75239]:   <nova:package version="0.0.0"/>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:name>tempest-device-tagging-server-1328986222</nova:name>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:creationTime>2023-11-13 20:39:30</nova:creationTime>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:flavor name="m1.tiny">
Nov 13 20:40:23 user nova-compute[75239]:     <nova:memory>512</nova:memory>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:disk>1</nova:disk>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:swap>0</nova:swap>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:vcpus>1</nova:vcpus>
Nov 13 20:40:23 user nova-compute[75239]:   </nova:flavor>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:owner>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:user uuid="276cb9cf493a47a0a8a4ea045e3277c4">tempest-TaggedAttachmentsTest-2035153286-project-member</nova:user>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:project uuid="fffa6e76e666484b8d3d4b66d58c1898">tempest-TaggedAttachmentsTest-2035153286</nova:project>
Nov 13 20:40:23 user nova-compute[75239]:   </nova:owner>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:ports>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:port uuid="a8636abe-8a8c-471f-add4-dbec8745a4a4">
Nov 13 20:40:23 user nova-compute[75239]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:40:23 user nova-compute[75239]:     </nova:port>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:port uuid="739b2b46-cd07-45c8-bca5-5d36c8c744b1">
Nov 13 20:40:23 user nova-compute[75239]:       <nova:ip type="fixed" address="10.10.10.41" ipVersion="4"/>
Nov 13 20:40:23 user nova-compute[75239]:     </nova:port>
Nov 13 20:40:23 user nova-compute[75239]:   </nova:ports>
Nov 13 20:40:23 user nova-compute[75239]: </nova:instance>
Nov 13 20:40:23 user nova-compute[75239]:   </metadata>
Nov 13 20:40:23 user nova-compute[75239]:   <memory unit='KiB'>524288</memory>
Nov 13 20:40:23 user nova-compute[75239]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 20:40:23 user nova-compute[75239]:   <vcpu placement='static'>1</vcpu>
Nov 13 20:40:23 user nova-compute[75239]:   <resource>
Nov 13 20:40:23 user nova-compute[75239]:     <partition>/machine</partition>
Nov 13 20:40:23 user nova-compute[75239]:   </resource>
Nov 13 20:40:23 user nova-compute[75239]:   <sysinfo type='smbios'>
Nov 13 20:40:23 user nova-compute[75239]:     <system>
Nov 13 20:40:23 user nova-compute[75239]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 20:40:23 user nova-compute[75239]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 20:40:23 user nova-compute[75239]:       <entry name='version'>0.0.0</entry>
Nov 13 20:40:23 user nova-compute[75239]:       <entry name='serial'>fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:40:23 user nova-compute[75239]:       <entry name='uuid'>fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:40:23 user nova-compute[75239]:       <entry name='family'>Virtual Machine</entry>
Nov 13 20:40:23 user nova-compute[75239]:     </system>
Nov 13 20:40:23 user nova-compute[75239]:   </sysinfo>
Nov 13 20:40:23 user nova-compute[75239]:   <os>
Nov 13 20:40:23 user nova-compute[75239]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 20:40:23 user nova-compute[75239]:     <boot dev='hd'/>
Nov 13 20:40:23 user nova-compute[75239]:     <smbios mode='sysinfo'/>
Nov 13 20:40:23 user nova-compute[75239]:   </os>
Nov 13 20:40:23 user nova-compute[75239]:   <features>
Nov 13 20:40:23 user nova-compute[75239]:     <acpi/>
Nov 13 20:40:23 user nova-compute[75239]:     <apic/>
Nov 13 20:40:23 user nova-compute[75239]:     <vmcoreinfo state='on'/>
Nov 13 20:40:23 user nova-compute[75239]:   </features>
Nov 13 20:40:23 user nova-compute[75239]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 20:40:23 user nova-compute[75239]:     <model fallback='forbid'>Nehalem</model>
Nov 13 20:40:23 user nova-compute[75239]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 20:40:23 user nova-compute[75239]:     <feature policy='require' name='vme'/>
Nov 13 20:40:23 user nova-compute[75239]:     <feature policy='require' name='x2apic'/>
Nov 13 20:40:23 user nova-compute[75239]:     <feature policy='require' name='hypervisor'/>
Nov 13 20:40:23 user nova-compute[75239]:   </cpu>
Nov 13 20:40:23 user nova-compute[75239]:   <clock offset='utc'>
Nov 13 20:40:23 user nova-compute[75239]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 20:40:23 user nova-compute[75239]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 20:40:23 user nova-compute[75239]:     <timer name='hpet' present='no'/>
Nov 13 20:40:23 user nova-compute[75239]:   </clock>
Nov 13 20:40:23 user nova-compute[75239]:   <on_poweroff>destroy</on_poweroff>
Nov 13 20:40:23 user nova-compute[75239]:   <on_reboot>restart</on_reboot>
Nov 13 20:40:23 user nova-compute[75239]:   <on_crash>destroy</on_crash>
Nov 13 20:40:23 user nova-compute[75239]:   <devices>
Nov 13 20:40:23 user nova-compute[75239]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 20:40:23 user nova-compute[75239]:     <disk type='file' device='disk'>
Nov 13 20:40:23 user nova-compute[75239]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 20:40:23 user nova-compute[75239]:       <source file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk' index='2'/>
Nov 13 20:40:23 user nova-compute[75239]:       <backingStore type='file' index='3'>
Nov 13 20:40:23 user nova-compute[75239]:         <format type='raw'/>
Nov 13 20:40:23 user nova-compute[75239]:         <source file='/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79'/>
Nov 13 20:40:23 user nova-compute[75239]:         <backingStore/>
Nov 13 20:40:23 user nova-compute[75239]:       </backingStore>
Nov 13 20:40:23 user nova-compute[75239]:       <target dev='vda' bus='virtio'/>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='virtio-disk0'/>
Nov 13 20:40:23 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </disk>
Nov 13 20:40:23 user nova-compute[75239]:     <disk type='file' device='cdrom'>
Nov 13 20:40:23 user nova-compute[75239]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 20:40:23 user nova-compute[75239]:       <source file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.config' index='1'/>
Nov 13 20:40:23 user nova-compute[75239]:       <backingStore/>
Nov 13 20:40:23 user nova-compute[75239]:       <target dev='hda' bus='ide'/>
Nov 13 20:40:23 user nova-compute[75239]:       <readonly/>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='ide0-0-0'/>
Nov 13 20:40:23 user nova-compute[75239]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </disk>
Nov 13 20:40:23 user nova-compute[75239]:     <controller type='usb' index='0' model='none'>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='usb'/>
Nov 13 20:40:23 user nova-compute[75239]:     </controller>
Nov 13 20:40:23 user nova-compute[75239]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='pci.0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </controller>
Nov 13 20:40:23 user nova-compute[75239]:     <controller type='ide' index='0'>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='ide'/>
Nov 13 20:40:23 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 20:40:23 user nova-compute[75239]:     </controller>
Nov 13 20:40:23 user nova-compute[75239]:     <interface type='ethernet'>
Nov 13 20:40:23 user nova-compute[75239]:       <mac address='fa:16:3e:8e:01:3d'/>
Nov 13 20:40:23 user nova-compute[75239]:       <target dev='tapa8636abe-8a'/>
Nov 13 20:40:23 user nova-compute[75239]:       <model type='virtio'/>
Nov 13 20:40:23 user nova-compute[75239]:       <mtu size='1442'/>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='net0'/>
Nov 13 20:40:23 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </interface>
Nov 13 20:40:23 user nova-compute[75239]:     <serial type='pty'>
Nov 13 20:40:23 user nova-compute[75239]:       <source path='/dev/pts/2'/>
Nov 13 20:40:23 user nova-compute[75239]:       <log file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log' append='off'/>
Nov 13 20:40:23 user nova-compute[75239]:       <target type='isa-serial' port='0'>
Nov 13 20:40:23 user nova-compute[75239]:         <model name='isa-serial'/>
Nov 13 20:40:23 user nova-compute[75239]:       </target>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='serial0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </serial>
Nov 13 20:40:23 user nova-compute[75239]:     <console type='pty' tty='/dev/pts/2'>
Nov 13 20:40:23 user nova-compute[75239]:       <source path='/dev/pts/2'/>
Nov 13 20:40:23 user nova-compute[75239]:       <log file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log' append='off'/>
Nov 13 20:40:23 user nova-compute[75239]:       <target type='serial' port='0'/>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='serial0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </console>
Nov 13 20:40:23 user nova-compute[75239]:     <input type='mouse' bus='ps2'>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='input0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </input>
Nov 13 20:40:23 user nova-compute[75239]:     <input type='keyboard' bus='ps2'>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='input1'/>
Nov 13 20:40:23 user nova-compute[75239]:     </input>
Nov 13 20:40:23 user nova-compute[75239]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 13 20:40:23 user nova-compute[75239]:       <listen type='address' address='0.0.0.0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </graphics>
Nov 13 20:40:23 user nova-compute[75239]:     <audio id='1' type='none'/>
Nov 13 20:40:23 user nova-compute[75239]:     <video>
Nov 13 20:40:23 user nova-compute[75239]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='video0'/>
Nov 13 20:40:23 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </video>
Nov 13 20:40:23 user nova-compute[75239]:     <memballoon model='virtio'>
Nov 13 20:40:23 user nova-compute[75239]:       <stats period='10'/>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='balloon0'/>
Nov 13 20:40:23 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </memballoon>
Nov 13 20:40:23 user nova-compute[75239]:     <rng model='virtio'>
Nov 13 20:40:23 user nova-compute[75239]:       <backend model='random'>/dev/urandom</backend>
Nov 13 20:40:23 user nova-compute[75239]:       <alias name='rng0'/>
Nov 13 20:40:23 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 20:40:23 user nova-compute[75239]:     </rng>
Nov 13 20:40:23 user nova-compute[75239]:   </devices>
Nov 13 20:40:23 user nova-compute[75239]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 20:40:23 user nova-compute[75239]:     <label>libvirt-fcafe860-22f2-4e7f-b1fc-d515c81762bc</label>
Nov 13 20:40:23 user nova-compute[75239]:     <imagelabel>libvirt-fcafe860-22f2-4e7f-b1fc-d515c81762bc</imagelabel>
Nov 13 20:40:23 user nova-compute[75239]:   </seclabel>
Nov 13 20:40:23 user nova-compute[75239]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 20:40:23 user nova-compute[75239]:     <label>+64055:+108</label>
Nov 13 20:40:23 user nova-compute[75239]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 20:40:23 user nova-compute[75239]:   </seclabel>
Nov 13 20:40:23 user nova-compute[75239]: </domain>
Nov 13 20:40:23 user nova-compute[75239]:  {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 20:40:23 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Successfully detached device tap739b2b46-cd from instance fcafe860-22f2-4e7f-b1fc-d515c81762bc from the live domain config.
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328986222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328986222',id=20,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzePX1hT2woml8vSrOF8vsehzyoQyDIDpKzXNnSV7g611OdghErTyj7yzdlaSTAX9UCgl8tKvGNN0b/Ma50TAXHkeoKbz087TbCFE625mSyZ4RbQrLqedGEnT1H3VPyVA==',key_name='tempest-keypair-989254085',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fffa6e76e666484b8d3d4b66d58c1898',ramdisk_id='',reservation_id='r-fektjpro',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2035153286',owner_user_name='tempest-TaggedAttachmentsTest-2035153286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276cb9cf493a47a0a8a4ea045e3277c4',uuid=fcafe860-22f2-4e7f-b1fc-d515c81762bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converting VIF {"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG os_vif [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap739b2b46-cd, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68c562d1-4512-48f7-9745-f4ff38b3826a) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:23 user nova-compute[75239]: INFO os_vif [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd')
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:40:23 user nova-compute[75239]:   <nova:package version="0.0.0"/>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:name>tempest-device-tagging-server-1328986222</nova:name>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:creationTime>2023-11-13 20:40:23</nova:creationTime>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:flavor name="m1.tiny">
Nov 13 20:40:23 user nova-compute[75239]:     <nova:memory>512</nova:memory>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:disk>1</nova:disk>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:swap>0</nova:swap>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:vcpus>1</nova:vcpus>
Nov 13 20:40:23 user nova-compute[75239]:   </nova:flavor>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:owner>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:user uuid="276cb9cf493a47a0a8a4ea045e3277c4">tempest-TaggedAttachmentsTest-2035153286-project-member</nova:user>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:project uuid="fffa6e76e666484b8d3d4b66d58c1898">tempest-TaggedAttachmentsTest-2035153286</nova:project>
Nov 13 20:40:23 user nova-compute[75239]:   </nova:owner>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:40:23 user nova-compute[75239]:   <nova:ports>
Nov 13 20:40:23 user nova-compute[75239]:     <nova:port uuid="a8636abe-8a8c-471f-add4-dbec8745a4a4">
Nov 13 20:40:23 user nova-compute[75239]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:40:23 user nova-compute[75239]:     </nova:port>
Nov 13 20:40:23 user nova-compute[75239]:   </nova:ports>
Nov 13 20:40:23 user nova-compute[75239]: </nova:instance>
Nov 13 20:40:23 user nova-compute[75239]:  {{(pid=75239) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.virt.images [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] 1272dd96-03a4-4f1d-8638-2baf2982e57b was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa.part /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b7a5d61-e890-4186-9ac4-0db96f2425e3 req-956e92e5-692f-4b2b-b290-61afdf10a52e service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b7a5d61-e890-4186-9ac4-0db96f2425e3 req-956e92e5-692f-4b2b-b290-61afdf10a52e service nova] Acquiring lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b7a5d61-e890-4186-9ac4-0db96f2425e3 req-956e92e5-692f-4b2b-b290-61afdf10a52e service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b7a5d61-e890-4186-9ac4-0db96f2425e3 req-956e92e5-692f-4b2b-b290-61afdf10a52e service nova] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b7a5d61-e890-4186-9ac4-0db96f2425e3 req-956e92e5-692f-4b2b-b290-61afdf10a52e service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] No waiting events found dispatching network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:23 user nova-compute[75239]: WARNING nova.compute.manager [req-8b7a5d61-e890-4186-9ac4-0db96f2425e3 req-956e92e5-692f-4b2b-b290-61afdf10a52e service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received unexpected event network-vif-plugged-37dadfef-e9b8-45fe-a9f2-901e412a21d0 for instance with vm_state active and task_state deleting.
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa.part /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa.converted" returned: 0 in 0.300s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1262e370fd64eaf3df14ee84eb577c607d631afa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.478s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa --force-share --output=json" returned: 0 in 0.438s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "1262e370fd64eaf3df14ee84eb577c607d631afa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1262e370fd64eaf3df14ee84eb577c607d631afa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa,backing_fmt=raw /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa,backing_fmt=raw /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk 1073741824" returned: 0 in 0.053s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1262e370fd64eaf3df14ee84eb577c607d631afa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-deleted-739b2b46-cd07-45c8-bca5-5d36c8c744b1 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:24 user nova-compute[75239]: INFO nova.compute.manager [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Neutron deleted interface 739b2b46-cd07-45c8-bca5-5d36c8c744b1; detaching it from the instance and deleting it from the info cache
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.network.neutron [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updating instance_info_cache with network_info: [{"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.objects.instance [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] Lazy-loading 'system_metadata' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquired lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:40:24 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Took 2.29 seconds to deallocate network for instance.
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Ensure instance console log exists: /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.objects.instance [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] Lazy-loading 'flavor' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.objects.base [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] Object Instance<fcafe860-22f2-4e7f-b1fc-d515c81762bc> lazy-loaded attributes: system_metadata,flavor {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328986222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328986222',id=20,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzePX1hT2woml8vSrOF8vsehzyoQyDIDpKzXNnSV7g611OdghErTyj7yzdlaSTAX9UCgl8tKvGNN0b/Ma50TAXHkeoKbz087TbCFE625mSyZ4RbQrLqedGEnT1H3VPyVA==',key_name='tempest-keypair-989254085',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fffa6e76e666484b8d3d4b66d58c1898',ramdisk_id='',reservation_id='r-fektjpro',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2035153286',owner_user_name='tempest-TaggedAttachmentsTest-2035153286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276cb9cf493a47a0a8a4ea045e3277c4',uuid=fcafe860-22f2-4e7f-b1fc-d515c81762bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.network.os_vif_util [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] Converting VIF {"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.network.os_vif_util [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface> {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface>not found in domain: <domain type='kvm' id='23'>
Nov 13 20:40:24 user nova-compute[75239]:   <name>instance-00000014</name>
Nov 13 20:40:24 user nova-compute[75239]:   <uuid>fcafe860-22f2-4e7f-b1fc-d515c81762bc</uuid>
Nov 13 20:40:24 user nova-compute[75239]:   <metadata>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:40:24 user nova-compute[75239]:   <nova:package version="0.0.0"/>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:name>tempest-device-tagging-server-1328986222</nova:name>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:creationTime>2023-11-13 20:40:23</nova:creationTime>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:flavor name="m1.tiny">
Nov 13 20:40:24 user nova-compute[75239]:     <nova:memory>512</nova:memory>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:disk>1</nova:disk>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:swap>0</nova:swap>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:vcpus>1</nova:vcpus>
Nov 13 20:40:24 user nova-compute[75239]:   </nova:flavor>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:owner>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:user uuid="276cb9cf493a47a0a8a4ea045e3277c4">tempest-TaggedAttachmentsTest-2035153286-project-member</nova:user>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:project uuid="fffa6e76e666484b8d3d4b66d58c1898">tempest-TaggedAttachmentsTest-2035153286</nova:project>
Nov 13 20:40:24 user nova-compute[75239]:   </nova:owner>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:ports>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:port uuid="a8636abe-8a8c-471f-add4-dbec8745a4a4">
Nov 13 20:40:24 user nova-compute[75239]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:40:24 user nova-compute[75239]:     </nova:port>
Nov 13 20:40:24 user nova-compute[75239]:   </nova:ports>
Nov 13 20:40:24 user nova-compute[75239]: </nova:instance>
Nov 13 20:40:24 user nova-compute[75239]:   </metadata>
Nov 13 20:40:24 user nova-compute[75239]:   <memory unit='KiB'>524288</memory>
Nov 13 20:40:24 user nova-compute[75239]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 20:40:24 user nova-compute[75239]:   <vcpu placement='static'>1</vcpu>
Nov 13 20:40:24 user nova-compute[75239]:   <resource>
Nov 13 20:40:24 user nova-compute[75239]:     <partition>/machine</partition>
Nov 13 20:40:24 user nova-compute[75239]:   </resource>
Nov 13 20:40:24 user nova-compute[75239]:   <sysinfo type='smbios'>
Nov 13 20:40:24 user nova-compute[75239]:     <system>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='version'>0.0.0</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='serial'>fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='uuid'>fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='family'>Virtual Machine</entry>
Nov 13 20:40:24 user nova-compute[75239]:     </system>
Nov 13 20:40:24 user nova-compute[75239]:   </sysinfo>
Nov 13 20:40:24 user nova-compute[75239]:   <os>
Nov 13 20:40:24 user nova-compute[75239]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 20:40:24 user nova-compute[75239]:     <boot dev='hd'/>
Nov 13 20:40:24 user nova-compute[75239]:     <smbios mode='sysinfo'/>
Nov 13 20:40:24 user nova-compute[75239]:   </os>
Nov 13 20:40:24 user nova-compute[75239]:   <features>
Nov 13 20:40:24 user nova-compute[75239]:     <acpi/>
Nov 13 20:40:24 user nova-compute[75239]:     <apic/>
Nov 13 20:40:24 user nova-compute[75239]:     <vmcoreinfo state='on'/>
Nov 13 20:40:24 user nova-compute[75239]:   </features>
Nov 13 20:40:24 user nova-compute[75239]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 20:40:24 user nova-compute[75239]:     <model fallback='forbid'>Nehalem</model>
Nov 13 20:40:24 user nova-compute[75239]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 20:40:24 user nova-compute[75239]:     <feature policy='require' name='vme'/>
Nov 13 20:40:24 user nova-compute[75239]:     <feature policy='require' name='x2apic'/>
Nov 13 20:40:24 user nova-compute[75239]:     <feature policy='require' name='hypervisor'/>
Nov 13 20:40:24 user nova-compute[75239]:   </cpu>
Nov 13 20:40:24 user nova-compute[75239]:   <clock offset='utc'>
Nov 13 20:40:24 user nova-compute[75239]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 20:40:24 user nova-compute[75239]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 20:40:24 user nova-compute[75239]:     <timer name='hpet' present='no'/>
Nov 13 20:40:24 user nova-compute[75239]:   </clock>
Nov 13 20:40:24 user nova-compute[75239]:   <on_poweroff>destroy</on_poweroff>
Nov 13 20:40:24 user nova-compute[75239]:   <on_reboot>restart</on_reboot>
Nov 13 20:40:24 user nova-compute[75239]:   <on_crash>destroy</on_crash>
Nov 13 20:40:24 user nova-compute[75239]:   <devices>
Nov 13 20:40:24 user nova-compute[75239]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 20:40:24 user nova-compute[75239]:     <disk type='file' device='disk'>
Nov 13 20:40:24 user nova-compute[75239]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 20:40:24 user nova-compute[75239]:       <source file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk' index='2'/>
Nov 13 20:40:24 user nova-compute[75239]:       <backingStore type='file' index='3'>
Nov 13 20:40:24 user nova-compute[75239]:         <format type='raw'/>
Nov 13 20:40:24 user nova-compute[75239]:         <source file='/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79'/>
Nov 13 20:40:24 user nova-compute[75239]:         <backingStore/>
Nov 13 20:40:24 user nova-compute[75239]:       </backingStore>
Nov 13 20:40:24 user nova-compute[75239]:       <target dev='vda' bus='virtio'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='virtio-disk0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </disk>
Nov 13 20:40:24 user nova-compute[75239]:     <disk type='file' device='cdrom'>
Nov 13 20:40:24 user nova-compute[75239]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 20:40:24 user nova-compute[75239]:       <source file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.config' index='1'/>
Nov 13 20:40:24 user nova-compute[75239]:       <backingStore/>
Nov 13 20:40:24 user nova-compute[75239]:       <target dev='hda' bus='ide'/>
Nov 13 20:40:24 user nova-compute[75239]:       <readonly/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='ide0-0-0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </disk>
Nov 13 20:40:24 user nova-compute[75239]:     <controller type='usb' index='0' model='none'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='usb'/>
Nov 13 20:40:24 user nova-compute[75239]:     </controller>
Nov 13 20:40:24 user nova-compute[75239]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='pci.0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </controller>
Nov 13 20:40:24 user nova-compute[75239]:     <controller type='ide' index='0'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='ide'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 20:40:24 user nova-compute[75239]:     </controller>
Nov 13 20:40:24 user nova-compute[75239]:     <interface type='ethernet'>
Nov 13 20:40:24 user nova-compute[75239]:       <mac address='fa:16:3e:8e:01:3d'/>
Nov 13 20:40:24 user nova-compute[75239]:       <target dev='tapa8636abe-8a'/>
Nov 13 20:40:24 user nova-compute[75239]:       <model type='virtio'/>
Nov 13 20:40:24 user nova-compute[75239]:       <mtu size='1442'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='net0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </interface>
Nov 13 20:40:24 user nova-compute[75239]:     <serial type='pty'>
Nov 13 20:40:24 user nova-compute[75239]:       <source path='/dev/pts/2'/>
Nov 13 20:40:24 user nova-compute[75239]:       <log file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log' append='off'/>
Nov 13 20:40:24 user nova-compute[75239]:       <target type='isa-serial' port='0'>
Nov 13 20:40:24 user nova-compute[75239]:         <model name='isa-serial'/>
Nov 13 20:40:24 user nova-compute[75239]:       </target>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='serial0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </serial>
Nov 13 20:40:24 user nova-compute[75239]:     <console type='pty' tty='/dev/pts/2'>
Nov 13 20:40:24 user nova-compute[75239]:       <source path='/dev/pts/2'/>
Nov 13 20:40:24 user nova-compute[75239]:       <log file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log' append='off'/>
Nov 13 20:40:24 user nova-compute[75239]:       <target type='serial' port='0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='serial0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </console>
Nov 13 20:40:24 user nova-compute[75239]:     <input type='mouse' bus='ps2'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='input0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </input>
Nov 13 20:40:24 user nova-compute[75239]:     <input type='keyboard' bus='ps2'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='input1'/>
Nov 13 20:40:24 user nova-compute[75239]:     </input>
Nov 13 20:40:24 user nova-compute[75239]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 13 20:40:24 user nova-compute[75239]:       <listen type='address' address='0.0.0.0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </graphics>
Nov 13 20:40:24 user nova-compute[75239]:     <audio id='1' type='none'/>
Nov 13 20:40:24 user nova-compute[75239]:     <video>
Nov 13 20:40:24 user nova-compute[75239]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='video0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </video>
Nov 13 20:40:24 user nova-compute[75239]:     <memballoon model='virtio'>
Nov 13 20:40:24 user nova-compute[75239]:       <stats period='10'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='balloon0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </memballoon>
Nov 13 20:40:24 user nova-compute[75239]:     <rng model='virtio'>
Nov 13 20:40:24 user nova-compute[75239]:       <backend model='random'>/dev/urandom</backend>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='rng0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </rng>
Nov 13 20:40:24 user nova-compute[75239]:   </devices>
Nov 13 20:40:24 user nova-compute[75239]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 20:40:24 user nova-compute[75239]:     <label>libvirt-fcafe860-22f2-4e7f-b1fc-d515c81762bc</label>
Nov 13 20:40:24 user nova-compute[75239]:     <imagelabel>libvirt-fcafe860-22f2-4e7f-b1fc-d515c81762bc</imagelabel>
Nov 13 20:40:24 user nova-compute[75239]:   </seclabel>
Nov 13 20:40:24 user nova-compute[75239]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 20:40:24 user nova-compute[75239]:     <label>+64055:+108</label>
Nov 13 20:40:24 user nova-compute[75239]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 20:40:24 user nova-compute[75239]:   </seclabel>
Nov 13 20:40:24 user nova-compute[75239]: </domain>
Nov 13 20:40:24 user nova-compute[75239]:  {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface> {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b2:3a:2f"/><model type="virtio"/><mtu size="1442"/><target dev="tap739b2b46-cd"/></interface>not found in domain: <domain type='kvm' id='23'>
Nov 13 20:40:24 user nova-compute[75239]:   <name>instance-00000014</name>
Nov 13 20:40:24 user nova-compute[75239]:   <uuid>fcafe860-22f2-4e7f-b1fc-d515c81762bc</uuid>
Nov 13 20:40:24 user nova-compute[75239]:   <metadata>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:40:24 user nova-compute[75239]:   <nova:package version="0.0.0"/>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:name>tempest-device-tagging-server-1328986222</nova:name>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:creationTime>2023-11-13 20:40:23</nova:creationTime>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:flavor name="m1.tiny">
Nov 13 20:40:24 user nova-compute[75239]:     <nova:memory>512</nova:memory>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:disk>1</nova:disk>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:swap>0</nova:swap>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:vcpus>1</nova:vcpus>
Nov 13 20:40:24 user nova-compute[75239]:   </nova:flavor>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:owner>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:user uuid="276cb9cf493a47a0a8a4ea045e3277c4">tempest-TaggedAttachmentsTest-2035153286-project-member</nova:user>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:project uuid="fffa6e76e666484b8d3d4b66d58c1898">tempest-TaggedAttachmentsTest-2035153286</nova:project>
Nov 13 20:40:24 user nova-compute[75239]:   </nova:owner>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:ports>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:port uuid="a8636abe-8a8c-471f-add4-dbec8745a4a4">
Nov 13 20:40:24 user nova-compute[75239]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:40:24 user nova-compute[75239]:     </nova:port>
Nov 13 20:40:24 user nova-compute[75239]:   </nova:ports>
Nov 13 20:40:24 user nova-compute[75239]: </nova:instance>
Nov 13 20:40:24 user nova-compute[75239]:   </metadata>
Nov 13 20:40:24 user nova-compute[75239]:   <memory unit='KiB'>524288</memory>
Nov 13 20:40:24 user nova-compute[75239]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 20:40:24 user nova-compute[75239]:   <vcpu placement='static'>1</vcpu>
Nov 13 20:40:24 user nova-compute[75239]:   <resource>
Nov 13 20:40:24 user nova-compute[75239]:     <partition>/machine</partition>
Nov 13 20:40:24 user nova-compute[75239]:   </resource>
Nov 13 20:40:24 user nova-compute[75239]:   <sysinfo type='smbios'>
Nov 13 20:40:24 user nova-compute[75239]:     <system>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='version'>0.0.0</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='serial'>fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='uuid'>fcafe860-22f2-4e7f-b1fc-d515c81762bc</entry>
Nov 13 20:40:24 user nova-compute[75239]:       <entry name='family'>Virtual Machine</entry>
Nov 13 20:40:24 user nova-compute[75239]:     </system>
Nov 13 20:40:24 user nova-compute[75239]:   </sysinfo>
Nov 13 20:40:24 user nova-compute[75239]:   <os>
Nov 13 20:40:24 user nova-compute[75239]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 20:40:24 user nova-compute[75239]:     <boot dev='hd'/>
Nov 13 20:40:24 user nova-compute[75239]:     <smbios mode='sysinfo'/>
Nov 13 20:40:24 user nova-compute[75239]:   </os>
Nov 13 20:40:24 user nova-compute[75239]:   <features>
Nov 13 20:40:24 user nova-compute[75239]:     <acpi/>
Nov 13 20:40:24 user nova-compute[75239]:     <apic/>
Nov 13 20:40:24 user nova-compute[75239]:     <vmcoreinfo state='on'/>
Nov 13 20:40:24 user nova-compute[75239]:   </features>
Nov 13 20:40:24 user nova-compute[75239]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 20:40:24 user nova-compute[75239]:     <model fallback='forbid'>Nehalem</model>
Nov 13 20:40:24 user nova-compute[75239]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 20:40:24 user nova-compute[75239]:     <feature policy='require' name='vme'/>
Nov 13 20:40:24 user nova-compute[75239]:     <feature policy='require' name='x2apic'/>
Nov 13 20:40:24 user nova-compute[75239]:     <feature policy='require' name='hypervisor'/>
Nov 13 20:40:24 user nova-compute[75239]:   </cpu>
Nov 13 20:40:24 user nova-compute[75239]:   <clock offset='utc'>
Nov 13 20:40:24 user nova-compute[75239]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 20:40:24 user nova-compute[75239]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 20:40:24 user nova-compute[75239]:     <timer name='hpet' present='no'/>
Nov 13 20:40:24 user nova-compute[75239]:   </clock>
Nov 13 20:40:24 user nova-compute[75239]:   <on_poweroff>destroy</on_poweroff>
Nov 13 20:40:24 user nova-compute[75239]:   <on_reboot>restart</on_reboot>
Nov 13 20:40:24 user nova-compute[75239]:   <on_crash>destroy</on_crash>
Nov 13 20:40:24 user nova-compute[75239]:   <devices>
Nov 13 20:40:24 user nova-compute[75239]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 20:40:24 user nova-compute[75239]:     <disk type='file' device='disk'>
Nov 13 20:40:24 user nova-compute[75239]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 20:40:24 user nova-compute[75239]:       <source file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk' index='2'/>
Nov 13 20:40:24 user nova-compute[75239]:       <backingStore type='file' index='3'>
Nov 13 20:40:24 user nova-compute[75239]:         <format type='raw'/>
Nov 13 20:40:24 user nova-compute[75239]:         <source file='/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79'/>
Nov 13 20:40:24 user nova-compute[75239]:         <backingStore/>
Nov 13 20:40:24 user nova-compute[75239]:       </backingStore>
Nov 13 20:40:24 user nova-compute[75239]:       <target dev='vda' bus='virtio'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='virtio-disk0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </disk>
Nov 13 20:40:24 user nova-compute[75239]:     <disk type='file' device='cdrom'>
Nov 13 20:40:24 user nova-compute[75239]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 20:40:24 user nova-compute[75239]:       <source file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk.config' index='1'/>
Nov 13 20:40:24 user nova-compute[75239]:       <backingStore/>
Nov 13 20:40:24 user nova-compute[75239]:       <target dev='hda' bus='ide'/>
Nov 13 20:40:24 user nova-compute[75239]:       <readonly/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='ide0-0-0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </disk>
Nov 13 20:40:24 user nova-compute[75239]:     <controller type='usb' index='0' model='none'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='usb'/>
Nov 13 20:40:24 user nova-compute[75239]:     </controller>
Nov 13 20:40:24 user nova-compute[75239]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='pci.0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </controller>
Nov 13 20:40:24 user nova-compute[75239]:     <controller type='ide' index='0'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='ide'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 20:40:24 user nova-compute[75239]:     </controller>
Nov 13 20:40:24 user nova-compute[75239]:     <interface type='ethernet'>
Nov 13 20:40:24 user nova-compute[75239]:       <mac address='fa:16:3e:8e:01:3d'/>
Nov 13 20:40:24 user nova-compute[75239]:       <target dev='tapa8636abe-8a'/>
Nov 13 20:40:24 user nova-compute[75239]:       <model type='virtio'/>
Nov 13 20:40:24 user nova-compute[75239]:       <mtu size='1442'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='net0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </interface>
Nov 13 20:40:24 user nova-compute[75239]:     <serial type='pty'>
Nov 13 20:40:24 user nova-compute[75239]:       <source path='/dev/pts/2'/>
Nov 13 20:40:24 user nova-compute[75239]:       <log file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log' append='off'/>
Nov 13 20:40:24 user nova-compute[75239]:       <target type='isa-serial' port='0'>
Nov 13 20:40:24 user nova-compute[75239]:         <model name='isa-serial'/>
Nov 13 20:40:24 user nova-compute[75239]:       </target>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='serial0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </serial>
Nov 13 20:40:24 user nova-compute[75239]:     <console type='pty' tty='/dev/pts/2'>
Nov 13 20:40:24 user nova-compute[75239]:       <source path='/dev/pts/2'/>
Nov 13 20:40:24 user nova-compute[75239]:       <log file='/opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/console.log' append='off'/>
Nov 13 20:40:24 user nova-compute[75239]:       <target type='serial' port='0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='serial0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </console>
Nov 13 20:40:24 user nova-compute[75239]:     <input type='mouse' bus='ps2'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='input0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </input>
Nov 13 20:40:24 user nova-compute[75239]:     <input type='keyboard' bus='ps2'>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='input1'/>
Nov 13 20:40:24 user nova-compute[75239]:     </input>
Nov 13 20:40:24 user nova-compute[75239]:     <graphics type='vnc' port='5900' autoport='yes' listen='0.0.0.0'>
Nov 13 20:40:24 user nova-compute[75239]:       <listen type='address' address='0.0.0.0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </graphics>
Nov 13 20:40:24 user nova-compute[75239]:     <audio id='1' type='none'/>
Nov 13 20:40:24 user nova-compute[75239]:     <video>
Nov 13 20:40:24 user nova-compute[75239]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='video0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </video>
Nov 13 20:40:24 user nova-compute[75239]:     <memballoon model='virtio'>
Nov 13 20:40:24 user nova-compute[75239]:       <stats period='10'/>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='balloon0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </memballoon>
Nov 13 20:40:24 user nova-compute[75239]:     <rng model='virtio'>
Nov 13 20:40:24 user nova-compute[75239]:       <backend model='random'>/dev/urandom</backend>
Nov 13 20:40:24 user nova-compute[75239]:       <alias name='rng0'/>
Nov 13 20:40:24 user nova-compute[75239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 20:40:24 user nova-compute[75239]:     </rng>
Nov 13 20:40:24 user nova-compute[75239]:   </devices>
Nov 13 20:40:24 user nova-compute[75239]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 20:40:24 user nova-compute[75239]:     <label>libvirt-fcafe860-22f2-4e7f-b1fc-d515c81762bc</label>
Nov 13 20:40:24 user nova-compute[75239]:     <imagelabel>libvirt-fcafe860-22f2-4e7f-b1fc-d515c81762bc</imagelabel>
Nov 13 20:40:24 user nova-compute[75239]:   </seclabel>
Nov 13 20:40:24 user nova-compute[75239]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 20:40:24 user nova-compute[75239]:     <label>+64055:+108</label>
Nov 13 20:40:24 user nova-compute[75239]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 20:40:24 user nova-compute[75239]:   </seclabel>
Nov 13 20:40:24 user nova-compute[75239]: </domain>
Nov 13 20:40:24 user nova-compute[75239]:  {{(pid=75239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 20:40:24 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Detaching interface fa:16:3e:b2:3a:2f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap739b2b46-cd' not found.
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328986222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328986222',id=20,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzePX1hT2woml8vSrOF8vsehzyoQyDIDpKzXNnSV7g611OdghErTyj7yzdlaSTAX9UCgl8tKvGNN0b/Ma50TAXHkeoKbz087TbCFE625mSyZ4RbQrLqedGEnT1H3VPyVA==',key_name='tempest-keypair-989254085',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fffa6e76e666484b8d3d4b66d58c1898',ramdisk_id='',reservation_id='r-fektjpro',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2035153286',owner_user_name='tempest-TaggedAttachmentsTest-2035153286-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276cb9cf493a47a0a8a4ea045e3277c4',uuid=fcafe860-22f2-4e7f-b1fc-d515c81762bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.network.os_vif_util [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] Converting VIF {"id": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "address": "fa:16:3e:b2:3a:2f", "network": {"id": "2d62b60c-46be-4853-b6e5-f276e6c2725c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2064116475", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b2b46-cd", "ovs_interfaceid": "739b2b46-cd07-45c8-bca5-5d36c8c744b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.network.os_vif_util [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG os_vif [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap739b2b46-cd, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:40:24 user nova-compute[75239]: INFO os_vif [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:3a:2f,bridge_name='br-int',has_traffic_filtering=True,id=739b2b46-cd07-45c8-bca5-5d36c8c744b1,network=Network(2d62b60c-46be-4853-b6e5-f276e6c2725c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b2b46-cd')
Nov 13 20:40:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [req-74e93277-33a8-4e03-ba5f-eaf129ba60d8 req-b3b0c666-8298-40e7-a4a0-0ce2d7b84e9f service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:40:24 user nova-compute[75239]:   <nova:package version="0.0.0"/>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:name>tempest-device-tagging-server-1328986222</nova:name>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:creationTime>2023-11-13 20:40:24</nova:creationTime>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:flavor name="m1.tiny">
Nov 13 20:40:24 user nova-compute[75239]:     <nova:memory>512</nova:memory>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:disk>1</nova:disk>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:swap>0</nova:swap>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:vcpus>1</nova:vcpus>
Nov 13 20:40:24 user nova-compute[75239]:   </nova:flavor>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:owner>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:user uuid="276cb9cf493a47a0a8a4ea045e3277c4">tempest-TaggedAttachmentsTest-2035153286-project-member</nova:user>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:project uuid="fffa6e76e666484b8d3d4b66d58c1898">tempest-TaggedAttachmentsTest-2035153286</nova:project>
Nov 13 20:40:24 user nova-compute[75239]:   </nova:owner>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:40:24 user nova-compute[75239]:   <nova:ports>
Nov 13 20:40:24 user nova-compute[75239]:     <nova:port uuid="a8636abe-8a8c-471f-add4-dbec8745a4a4">
Nov 13 20:40:24 user nova-compute[75239]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:40:24 user nova-compute[75239]:     </nova:port>
Nov 13 20:40:24 user nova-compute[75239]:   </nova:ports>
Nov 13 20:40:24 user nova-compute[75239]: </nova:instance>
Nov 13 20:40:24 user nova-compute[75239]:  {{(pid=75239) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Successfully updated port: 8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquired lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updating instance_info_cache with network_info: [{"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Releasing lock "refresh_cache-fcafe860-22f2-4e7f-b1fc-d515c81762bc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Updating instance_info_cache with network_info: [{"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Releasing lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Instance network_info: |[{"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d19596e5-257e-41ca-a723-ec7509db1446 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "interface-fcafe860-22f2-4e7f-b1fc-d515c81762bc-739b2b46-cd07-45c8-bca5-5d36c8c744b1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.766s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Start _get_guest_xml network_info=[{"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8bfad322240809f678b462c365ce08a6',container_format='bare',created_at=2023-11-13T20:40:14Z,direct_url=<?>,disk_format='qcow2',id=1272dd96-03a4-4f1d-8638-2baf2982e57b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1680532073',owner='d292feb205994cddb6f2765da53fee90',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T20:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '1272dd96-03a4-4f1d-8638-2baf2982e57b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:40:25 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:40:25 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8bfad322240809f678b462c365ce08a6',container_format='bare',created_at=2023-11-13T20:40:14Z,direct_url=<?>,disk_format='qcow2',id=1272dd96-03a4-4f1d-8638-2baf2982e57b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1680532073',owner='d292feb205994cddb6f2765da53fee90',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T20:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-939999172',display_name='tempest-TestStampPattern-server-939999172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-939999172',id=23,image_ref='1272dd96-03a4-4f1d-8638-2baf2982e57b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsJkUh8tzjbwjGz2z/FPh6VoEoc5eNHl/mHpg0AYJPwTCL8t4LK5SGwpvdKX8mICr9zRERa/UEuI0kQJy2b6EW0qfB+fmIFb5tJy6989x+nGNRdNksl6VWF1E+4Wj6iBQ==',key_name='tempest-TestStampPattern-1567089186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d292feb205994cddb6f2765da53fee90',ramdisk_id='',reservation_id='r-gsqlj83x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1ec27628-db61-49c0-951b-6e72ac2f4f15',image_min_disk='1',image_min_ram='0',image_owner_id='d292feb205994cddb6f2765da53fee90',image_owner_project_name='tempest-TestStampPattern-1429319310',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1429319310-project-member',image_user_id='297728d5d4c4454a9f9acd594d24b232',network_allocated='True',owner_project_name='tempest-TestStampPattern-1429319310',owner_user_name='tempest-TestStampPattern-1429319310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:40:22Z,user_data=None,user_id='297728d5d4c4454a9f9acd594d24b232',uuid=0c4645d0-ba7a-4f2b-92fb-401891187489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converting VIF {"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:15,bridge_name='br-int',has_traffic_filtering=True,id=8f936d93-9923-4ea3-b6c6-a8ab85c07b29,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f936d93-99') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.objects.instance [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c4645d0-ba7a-4f2b-92fb-401891187489 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:25 user nova-compute[75239]: INFO nova.compute.manager [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Took 0.79 seconds to detach 1 volumes for instance.
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Deleting volume: 1faa23e0-a730-43ba-9425-eca3b7105d2f {{(pid=75239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:40:25 user nova-compute[75239]:   <uuid>0c4645d0-ba7a-4f2b-92fb-401891187489</uuid>
Nov 13 20:40:25 user nova-compute[75239]:   <name>instance-00000017</name>
Nov 13 20:40:25 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:40:25 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:40:25 user nova-compute[75239]:   <metadata>
Nov 13 20:40:25 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:40:25 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:40:25 user nova-compute[75239]:       <nova:name>tempest-TestStampPattern-server-939999172</nova:name>
Nov 13 20:40:25 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:40:25</nova:creationTime>
Nov 13 20:40:25 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:40:25 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:40:25 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:40:25 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:40:25 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:40:25 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:40:25 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:40:25 user nova-compute[75239]:       <nova:owner>
Nov 13 20:40:25 user nova-compute[75239]:         <nova:user uuid="297728d5d4c4454a9f9acd594d24b232">tempest-TestStampPattern-1429319310-project-member</nova:user>
Nov 13 20:40:25 user nova-compute[75239]:         <nova:project uuid="d292feb205994cddb6f2765da53fee90">tempest-TestStampPattern-1429319310</nova:project>
Nov 13 20:40:25 user nova-compute[75239]:       </nova:owner>
Nov 13 20:40:25 user nova-compute[75239]:       <nova:root type="image" uuid="1272dd96-03a4-4f1d-8638-2baf2982e57b"/>
Nov 13 20:40:25 user nova-compute[75239]:       <nova:ports>
Nov 13 20:40:25 user nova-compute[75239]:         <nova:port uuid="8f936d93-9923-4ea3-b6c6-a8ab85c07b29">
Nov 13 20:40:25 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:40:25 user nova-compute[75239]:         </nova:port>
Nov 13 20:40:25 user nova-compute[75239]:       </nova:ports>
Nov 13 20:40:25 user nova-compute[75239]:     </nova:instance>
Nov 13 20:40:25 user nova-compute[75239]:   </metadata>
Nov 13 20:40:25 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:40:25 user nova-compute[75239]:     <system>
Nov 13 20:40:25 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:40:25 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:40:25 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:40:25 user nova-compute[75239]:       <entry name="serial">0c4645d0-ba7a-4f2b-92fb-401891187489</entry>
Nov 13 20:40:25 user nova-compute[75239]:       <entry name="uuid">0c4645d0-ba7a-4f2b-92fb-401891187489</entry>
Nov 13 20:40:25 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:40:25 user nova-compute[75239]:     </system>
Nov 13 20:40:25 user nova-compute[75239]:   </sysinfo>
Nov 13 20:40:25 user nova-compute[75239]:   <os>
Nov 13 20:40:25 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:40:25 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:40:25 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:40:25 user nova-compute[75239]:   </os>
Nov 13 20:40:25 user nova-compute[75239]:   <features>
Nov 13 20:40:25 user nova-compute[75239]:     <acpi/>
Nov 13 20:40:25 user nova-compute[75239]:     <apic/>
Nov 13 20:40:25 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:40:25 user nova-compute[75239]:   </features>
Nov 13 20:40:25 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:40:25 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:40:25 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:40:25 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:40:25 user nova-compute[75239]:   </clock>
Nov 13 20:40:25 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:40:25 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:40:25 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:40:25 user nova-compute[75239]:   </cpu>
Nov 13 20:40:25 user nova-compute[75239]:   <devices>
Nov 13 20:40:25 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:40:25 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:40:25 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk"/>
Nov 13 20:40:25 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:40:25 user nova-compute[75239]:     </disk>
Nov 13 20:40:25 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:40:25 user nova-compute[75239]:       <mac address="fa:16:3e:47:49:15"/>
Nov 13 20:40:25 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:40:25 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:40:25 user nova-compute[75239]:       <target dev="tap8f936d93-99"/>
Nov 13 20:40:25 user nova-compute[75239]:     </interface>
Nov 13 20:40:25 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:40:25 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/console.log" append="off"/>
Nov 13 20:40:25 user nova-compute[75239]:     </serial>
Nov 13 20:40:25 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:40:25 user nova-compute[75239]:     <video>
Nov 13 20:40:25 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:40:25 user nova-compute[75239]:     </video>
Nov 13 20:40:25 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:40:25 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:40:25 user nova-compute[75239]:     </rng>
Nov 13 20:40:25 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:40:25 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:40:25 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:40:25 user nova-compute[75239]:     </memballoon>
Nov 13 20:40:25 user nova-compute[75239]:   </devices>
Nov 13 20:40:25 user nova-compute[75239]: </domain>
Nov 13 20:40:25 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-939999172',display_name='tempest-TestStampPattern-server-939999172',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-939999172',id=23,image_ref='1272dd96-03a4-4f1d-8638-2baf2982e57b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsJkUh8tzjbwjGz2z/FPh6VoEoc5eNHl/mHpg0AYJPwTCL8t4LK5SGwpvdKX8mICr9zRERa/UEuI0kQJy2b6EW0qfB+fmIFb5tJy6989x+nGNRdNksl6VWF1E+4Wj6iBQ==',key_name='tempest-TestStampPattern-1567089186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d292feb205994cddb6f2765da53fee90',ramdisk_id='',reservation_id='r-gsqlj83x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1ec27628-db61-49c0-951b-6e72ac2f4f15',image_min_disk='1',image_min_ram='0',image_owner_id='d292feb205994cddb6f2765da53fee90',image_owner_project_name='tempest-TestStampPattern-1429319310',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1429319310-project-member',image_user_id='297728d5d4c4454a9f9acd594d24b232',network_allocated='True',owner_project_name='tempest-TestStampPattern-1429319310',owner_user_name='tempest-TestStampPattern-1429319310-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:40:22Z,user_data=None,user_id='297728d5d4c4454a9f9acd594d24b232',uuid=0c4645d0-ba7a-4f2b-92fb-401891187489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converting VIF {"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:15,bridge_name='br-int',has_traffic_filtering=True,id=8f936d93-9923-4ea3-b6c6-a8ab85c07b29,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f936d93-99') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG os_vif [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:15,bridge_name='br-int',has_traffic_filtering=True,id=8f936d93-9923-4ea3-b6c6-a8ab85c07b29,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f936d93-99') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c8ad60bf-70bf-5237-ae08-605d5eeb0b84', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f936d93-99, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f936d93-99, col_values=(('qos', UUID('cb7f842c-902d-4b81-889e-654879c7a3aa')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f936d93-99, col_values=(('external_ids', {'iface-id': '8f936d93-9923-4ea3-b6c6-a8ab85c07b29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:49:15', 'vm-uuid': '0c4645d0-ba7a-4f2b-92fb-401891187489'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:25 user nova-compute[75239]: INFO os_vif [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:49:15,bridge_name='br-int',has_traffic_filtering=True,id=8f936d93-9923-4ea3-b6c6-a8ab85c07b29,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f936d93-99')
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No VIF found with MAC fa:16:3e:47:49:15, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.375s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:26 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Deleted allocations for instance 1fe94db5-cf69-4e80-a779-e2182588ab56
Nov 13 20:40:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d674048-55f5-4c7a-b3fb-a7802f321923 tempest-ServerActionsV293TestJSON-403999266 tempest-ServerActionsV293TestJSON-403999266-project-member] Lock "1fe94db5-cf69-4e80-a779-e2182588ab56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.975s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-3739f108-69b9-49ab-bbfc-e08fff9c63c0 req-1238fcbc-f399-45a5-8de8-4dce41f2c5c6 service nova] [instance: 1fe94db5-cf69-4e80-a779-e2182588ab56] Received event network-vif-deleted-37dadfef-e9b8-45fe-a9f2-901e412a21d0 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-3739f108-69b9-49ab-bbfc-e08fff9c63c0 req-1238fcbc-f399-45a5-8de8-4dce41f2c5c6 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received event network-changed-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-3739f108-69b9-49ab-bbfc-e08fff9c63c0 req-1238fcbc-f399-45a5-8de8-4dce41f2c5c6 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Refreshing instance network info cache due to event network-changed-8f936d93-9923-4ea3-b6c6-a8ab85c07b29. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3739f108-69b9-49ab-bbfc-e08fff9c63c0 req-1238fcbc-f399-45a5-8de8-4dce41f2c5c6 service nova] Acquiring lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3739f108-69b9-49ab-bbfc-e08fff9c63c0 req-1238fcbc-f399-45a5-8de8-4dce41f2c5c6 service nova] Acquired lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG nova.network.neutron [req-3739f108-69b9-49ab-bbfc-e08fff9c63c0 req-1238fcbc-f399-45a5-8de8-4dce41f2c5c6 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Refreshing network info cache for port 8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:40:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:27 user nova-compute[75239]: DEBUG nova.network.neutron [req-3739f108-69b9-49ab-bbfc-e08fff9c63c0 req-1238fcbc-f399-45a5-8de8-4dce41f2c5c6 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Updated VIF entry in instance network info cache for port 8f936d93-9923-4ea3-b6c6-a8ab85c07b29. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:40:27 user nova-compute[75239]: DEBUG nova.network.neutron [req-3739f108-69b9-49ab-bbfc-e08fff9c63c0 req-1238fcbc-f399-45a5-8de8-4dce41f2c5c6 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Updating instance_info_cache with network_info: [{"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:40:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3739f108-69b9-49ab-bbfc-e08fff9c63c0 req-1238fcbc-f399-45a5-8de8-4dce41f2c5c6 service nova] Releasing lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:40:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received event network-vif-plugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] No waiting events found dispatching network-vif-plugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:28 user nova-compute[75239]: WARNING nova.compute.manager [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received unexpected event network-vif-plugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 for instance with vm_state building and task_state spawning.
Nov 13 20:40:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received event network-vif-plugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] No waiting events found dispatching network-vif-plugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:28 user nova-compute[75239]: WARNING nova.compute.manager [req-2d14de78-b51d-4b88-8ad6-ff8d1d4d75ef req-1c8f929b-7827-42fc-bd6e-7219b7651fd8 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received unexpected event network-vif-plugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 for instance with vm_state building and task_state spawning.
Nov 13 20:40:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:40:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:40:29 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Instance spawned successfully.
Nov 13 20:40:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:40:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:40:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:40:29 user nova-compute[75239]: INFO nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Took 6.85 seconds to spawn the instance on the hypervisor.
Nov 13 20:40:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:40:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:29 user nova-compute[75239]: INFO nova.compute.manager [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Took 7.72 seconds to build instance.
Nov 13 20:40:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-da33dbb0-e1cb-48b8-a774-813de4d07768 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.832s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:40:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG nova.objects.instance [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquired lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG nova.network.neutron [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG nova.objects.instance [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'info_cache' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG nova.objects.base [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG nova.network.neutron [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating instance_info_cache with network_info: [{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:40:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Releasing lock "refresh_cache-f59ce508-2487-4e71-8c09-ffd17dd0eafc" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:40:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance destroyed successfully.
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'resources' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.base [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1584967376',display_name='tempest-AttachVolumeTestJSON-server-1584967376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1584967376',id=2,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKLqFZyQUrPE9Rky07V7+GOb/b3wRFXW0Dqh5CX+FEDomGoakG24id5wbLzS4TXRnaOkbwA4OVXWvMEC23O9oNn05+UEn3Pmq3JjLiMnSUlNw/+Sk65Td7hW84pUseSw==',key_name='tempest-keypair-823327680',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-9qfk4iec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=f59ce508-2487-4e71-8c09-ffd17dd0eafc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG os_vif [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf2c8770-f7, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d951ced-3009-41e0-b5d2-2a684d03578b) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:31 user nova-compute[75239]: INFO os_vif [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7')
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Start _get_guest_xml network_info=[{"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'numa_topology' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.base [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:40:31 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:40:31 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'vcpu_model' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.base [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1584967376',display_name='tempest-AttachVolumeTestJSON-server-1584967376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1584967376',id=2,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKLqFZyQUrPE9Rky07V7+GOb/b3wRFXW0Dqh5CX+FEDomGoakG24id5wbLzS4TXRnaOkbwA4OVXWvMEC23O9oNn05+UEn3Pmq3JjLiMnSUlNw/+Sk65Td7hW84pUseSw==',key_name='tempest-keypair-823327680',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-9qfk4iec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=f59ce508-2487-4e71-8c09-ffd17dd0eafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'pci_devices' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.base [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:40:31 user nova-compute[75239]:   <uuid>f59ce508-2487-4e71-8c09-ffd17dd0eafc</uuid>
Nov 13 20:40:31 user nova-compute[75239]:   <name>instance-00000002</name>
Nov 13 20:40:31 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:40:31 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:40:31 user nova-compute[75239]:   <metadata>
Nov 13 20:40:31 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:40:31 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:40:31 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeTestJSON-server-1584967376</nova:name>
Nov 13 20:40:31 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:40:31</nova:creationTime>
Nov 13 20:40:31 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:40:31 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:40:31 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:40:31 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:40:31 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:40:31 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:40:31 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:40:31 user nova-compute[75239]:       <nova:owner>
Nov 13 20:40:31 user nova-compute[75239]:         <nova:user uuid="a1fa0bf5a26e4844a22d48ce70d8dc0a">tempest-AttachVolumeTestJSON-2111443236-project-member</nova:user>
Nov 13 20:40:31 user nova-compute[75239]:         <nova:project uuid="b0a86eedbea84af3a57a6a4b266c06d4">tempest-AttachVolumeTestJSON-2111443236</nova:project>
Nov 13 20:40:31 user nova-compute[75239]:       </nova:owner>
Nov 13 20:40:31 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:40:31 user nova-compute[75239]:       <nova:ports>
Nov 13 20:40:31 user nova-compute[75239]:         <nova:port uuid="af2c8770-f7b4-4446-8061-7c377b8ad1f5">
Nov 13 20:40:31 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:40:31 user nova-compute[75239]:         </nova:port>
Nov 13 20:40:31 user nova-compute[75239]:       </nova:ports>
Nov 13 20:40:31 user nova-compute[75239]:     </nova:instance>
Nov 13 20:40:31 user nova-compute[75239]:   </metadata>
Nov 13 20:40:31 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:40:31 user nova-compute[75239]:     <system>
Nov 13 20:40:31 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:40:31 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:40:31 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:40:31 user nova-compute[75239]:       <entry name="serial">f59ce508-2487-4e71-8c09-ffd17dd0eafc</entry>
Nov 13 20:40:31 user nova-compute[75239]:       <entry name="uuid">f59ce508-2487-4e71-8c09-ffd17dd0eafc</entry>
Nov 13 20:40:31 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:40:31 user nova-compute[75239]:     </system>
Nov 13 20:40:31 user nova-compute[75239]:   </sysinfo>
Nov 13 20:40:31 user nova-compute[75239]:   <os>
Nov 13 20:40:31 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:40:31 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:40:31 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:40:31 user nova-compute[75239]:   </os>
Nov 13 20:40:31 user nova-compute[75239]:   <features>
Nov 13 20:40:31 user nova-compute[75239]:     <acpi/>
Nov 13 20:40:31 user nova-compute[75239]:     <apic/>
Nov 13 20:40:31 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:40:31 user nova-compute[75239]:   </features>
Nov 13 20:40:31 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:40:31 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:40:31 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:40:31 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:40:31 user nova-compute[75239]:   </clock>
Nov 13 20:40:31 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:40:31 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:40:31 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:40:31 user nova-compute[75239]:   </cpu>
Nov 13 20:40:31 user nova-compute[75239]:   <devices>
Nov 13 20:40:31 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:40:31 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:40:31 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk"/>
Nov 13 20:40:31 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:40:31 user nova-compute[75239]:     </disk>
Nov 13 20:40:31 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:40:31 user nova-compute[75239]:       <mac address="fa:16:3e:9f:11:19"/>
Nov 13 20:40:31 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:40:31 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:40:31 user nova-compute[75239]:       <target dev="tapaf2c8770-f7"/>
Nov 13 20:40:31 user nova-compute[75239]:     </interface>
Nov 13 20:40:31 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:40:31 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/console.log" append="off"/>
Nov 13 20:40:31 user nova-compute[75239]:     </serial>
Nov 13 20:40:31 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:40:31 user nova-compute[75239]:     <video>
Nov 13 20:40:31 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:40:31 user nova-compute[75239]:     </video>
Nov 13 20:40:31 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:40:31 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:40:31 user nova-compute[75239]:     </rng>
Nov 13 20:40:31 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:40:31 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:40:31 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:40:31 user nova-compute[75239]:     </memballoon>
Nov 13 20:40:31 user nova-compute[75239]:   </devices>
Nov 13 20:40:31 user nova-compute[75239]: </domain>
Nov 13 20:40:31 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'trusted_certs' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.base [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Cannot resize image /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:40:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'migration_context' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG nova.objects.base [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Object Instance<f59ce508-2487-4e71-8c09-ffd17dd0eafc> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1584967376',display_name='tempest-AttachVolumeTestJSON-server-1584967376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1584967376',id=2,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKLqFZyQUrPE9Rky07V7+GOb/b3wRFXW0Dqh5CX+FEDomGoakG24id5wbLzS4TXRnaOkbwA4OVXWvMEC23O9oNn05+UEn3Pmq3JjLiMnSUlNw/+Sk65Td7hW84pUseSw==',key_name='tempest-keypair-823327680',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-9qfk4iec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:38:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=f59ce508-2487-4e71-8c09-ffd17dd0eafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG os_vif [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf7f58c3-2746-521a-93e7-2a26466a9f03', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf2c8770-f7, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf2c8770-f7, col_values=(('qos', UUID('660c0715-3481-48ec-b9a1-46570efd225c')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf2c8770-f7, col_values=(('external_ids', {'iface-id': 'af2c8770-f7b4-4446-8061-7c377b8ad1f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:11:19', 'vm-uuid': 'f59ce508-2487-4e71-8c09-ffd17dd0eafc'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:32 user nova-compute[75239]: INFO os_vif [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7')
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-f650d4b4-53a7-4e6b-a4c0-d0533a0493b2 req-32b64560-29ab-4de0-8d92-6634b93b325a service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f650d4b4-53a7-4e6b-a4c0-d0533a0493b2 req-32b64560-29ab-4de0-8d92-6634b93b325a service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f650d4b4-53a7-4e6b-a4c0-d0533a0493b2 req-32b64560-29ab-4de0-8d92-6634b93b325a service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f650d4b4-53a7-4e6b-a4c0-d0533a0493b2 req-32b64560-29ab-4de0-8d92-6634b93b325a service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-f650d4b4-53a7-4e6b-a4c0-d0533a0493b2 req-32b64560-29ab-4de0-8d92-6634b93b325a service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:33 user nova-compute[75239]: WARNING nova.compute.manager [req-f650d4b4-53a7-4e6b-a4c0-d0533a0493b2 req-32b64560-29ab-4de0-8d92-6634b93b325a service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state powering-on.
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:40:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:40:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b0c7881-0161-43e5-8e64-3e1981bc1e03 req-8ec6c62f-c252-4c77-961e-81576fe6dee5 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b0c7881-0161-43e5-8e64-3e1981bc1e03 req-8ec6c62f-c252-4c77-961e-81576fe6dee5 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b0c7881-0161-43e5-8e64-3e1981bc1e03 req-8ec6c62f-c252-4c77-961e-81576fe6dee5 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8b0c7881-0161-43e5-8e64-3e1981bc1e03 req-8ec6c62f-c252-4c77-961e-81576fe6dee5 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-8b0c7881-0161-43e5-8e64-3e1981bc1e03 req-8ec6c62f-c252-4c77-961e-81576fe6dee5 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:35 user nova-compute[75239]: WARNING nova.compute.manager [req-8b0c7881-0161-43e5-8e64-3e1981bc1e03 req-8ec6c62f-c252-4c77-961e-81576fe6dee5 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state stopped and task_state powering-on.
Nov 13 20:40:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:40:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance rebooted successfully.
Nov 13 20:40:35 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:40:35 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:40:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7481MB free_disk=24.893054962158203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:40:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-55148f4a-385d-491f-a624-7361ea71b0e9 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 55f96b7f-454c-440a-9c78-f91305569e87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance fcafe860-22f2-4e7f-b1fc-d515c81762bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c3f6a68e-f57c-463f-81fd-e4e047421d5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 0c4645d0-ba7a-4f2b-92fb-401891187489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:40:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:40:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:40:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:40:37 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:40:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updating instance_info_cache with network_info: [{"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:40:40 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:40:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:53 user nova-compute[75239]: INFO nova.compute.manager [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Terminating instance
Nov 13 20:40:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG nova.compute.manager [req-fad78b3e-ed30-4df1-869f-46d170b859ab req-510b2424-e7f2-453f-8044-27d683fdcaad service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-unplugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fad78b3e-ed30-4df1-869f-46d170b859ab req-510b2424-e7f2-453f-8044-27d683fdcaad service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fad78b3e-ed30-4df1-869f-46d170b859ab req-510b2424-e7f2-453f-8044-27d683fdcaad service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fad78b3e-ed30-4df1-869f-46d170b859ab req-510b2424-e7f2-453f-8044-27d683fdcaad service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG nova.compute.manager [req-fad78b3e-ed30-4df1-869f-46d170b859ab req-510b2424-e7f2-453f-8044-27d683fdcaad service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-unplugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:53 user nova-compute[75239]: DEBUG nova.compute.manager [req-fad78b3e-ed30-4df1-869f-46d170b859ab req-510b2424-e7f2-453f-8044-27d683fdcaad service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-unplugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:54 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Instance destroyed successfully.
Nov 13 20:40:54 user nova-compute[75239]: DEBUG nova.objects.instance [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lazy-loading 'resources' on Instance uuid fcafe860-22f2-4e7f-b1fc-d515c81762bc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T20:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1328986222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1328986222',id=20,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzePX1hT2woml8vSrOF8vsehzyoQyDIDpKzXNnSV7g611OdghErTyj7yzdlaSTAX9UCgl8tKvGNN0b/Ma50TAXHkeoKbz087TbCFE625mSyZ4RbQrLqedGEnT1H3VPyVA==',key_name='tempest-keypair-989254085',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:37:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fffa6e76e666484b8d3d4b66d58c1898',ramdisk_id='',reservation_id='r-fektjpro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2035153286',owner_user_name='tempest-TaggedAttachmentsTest-2035153286-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:37:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='276cb9cf493a47a0a8a4ea045e3277c4',uuid=fcafe860-22f2-4e7f-b1fc-d515c81762bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converting VIF {"id": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "address": "fa:16:3e:8e:01:3d", "network": {"id": "af8e991b-e71b-495e-8738-aa6a6ca1b086", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-451394226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fffa6e76e666484b8d3d4b66d58c1898", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8636abe-8a", "ovs_interfaceid": "a8636abe-8a8c-471f-add4-dbec8745a4a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:01:3d,bridge_name='br-int',has_traffic_filtering=True,id=a8636abe-8a8c-471f-add4-dbec8745a4a4,network=Network(af8e991b-e71b-495e-8738-aa6a6ca1b086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8636abe-8a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG os_vif [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:01:3d,bridge_name='br-int',has_traffic_filtering=True,id=a8636abe-8a8c-471f-add4-dbec8745a4a4,network=Network(af8e991b-e71b-495e-8738-aa6a6ca1b086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8636abe-8a') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8636abe-8a, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3d79de9-adab-4169-8c34-86b4750112c1) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:40:54 user nova-compute[75239]: INFO os_vif [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:01:3d,bridge_name='br-int',has_traffic_filtering=True,id=a8636abe-8a8c-471f-add4-dbec8745a4a4,network=Network(af8e991b-e71b-495e-8738-aa6a6ca1b086),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8636abe-8a')
Nov 13 20:40:54 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Deleting instance files /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc_del
Nov 13 20:40:54 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Deletion of /opt/stack/data/nova/instances/fcafe860-22f2-4e7f-b1fc-d515c81762bc_del complete
Nov 13 20:40:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:54 user nova-compute[75239]: INFO nova.compute.manager [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 13 20:40:54 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:40:54 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:40:55 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Took 0.84 seconds to deallocate network for instance.
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-da19141b-b935-4251-9b50-672402f84271 req-09f1e5cf-c633-4e2a-b4dd-79f5b5bd5349 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-deleted-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:55 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Deleted allocations for instance fcafe860-22f2-4e7f-b1fc-d515c81762bc
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:55 user nova-compute[75239]: WARNING nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 for instance with vm_state deleted and task_state None.
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:55 user nova-compute[75239]: WARNING nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 for instance with vm_state deleted and task_state None.
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:55 user nova-compute[75239]: WARNING nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 for instance with vm_state deleted and task_state None.
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-unplugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-unplugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:55 user nova-compute[75239]: WARNING nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-unplugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 for instance with vm_state deleted and task_state None.
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Acquiring lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] No waiting events found dispatching network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:40:55 user nova-compute[75239]: WARNING nova.compute.manager [req-222385fe-b8f0-4ab1-926d-7d9b346189cd req-3616eecb-779f-4913-90d7-612917470fc0 service nova] [instance: fcafe860-22f2-4e7f-b1fc-d515c81762bc] Received unexpected event network-vif-plugged-a8636abe-8a8c-471f-add4-dbec8745a4a4 for instance with vm_state deleted and task_state None.
Nov 13 20:40:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-52317c09-0883-46dd-8b17-2085defe1466 tempest-TaggedAttachmentsTest-2035153286 tempest-TaggedAttachmentsTest-2035153286-project-member] Lock "fcafe860-22f2-4e7f-b1fc-d515c81762bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:40:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:40:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:41:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:08 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:41:08 user nova-compute[75239]: INFO nova.compute.claims [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Claim successful on node user
Nov 13 20:41:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:41:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:41:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG nova.policy [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2669d647fe6f4034bc70703546345eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465510aec2849dfb0917120a772f066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:41:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Creating image(s)
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "/opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "/opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk 1073741824" returned: 0 in 0.072s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Successfully created port: 7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.195s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Cannot resize image /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Ensure instance console log exists: /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Successfully updated port: 7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "refresh_cache-cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquired lock "refresh_cache-cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-8160fad5-0381-4451-86f3-7891143b854f req-25be7de3-52c2-4526-916c-86721f8d5a02 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received event network-changed-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-8160fad5-0381-4451-86f3-7891143b854f req-25be7de3-52c2-4526-916c-86721f8d5a02 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Refreshing instance network info cache due to event network-changed-7be9bad0-818f-4a3c-a268-eee73dca9d13. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8160fad5-0381-4451-86f3-7891143b854f req-25be7de3-52c2-4526-916c-86721f8d5a02 service nova] Acquiring lock "refresh_cache-cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:41:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Updating instance_info_cache with network_info: [{"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Releasing lock "refresh_cache-cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Instance network_info: |[{"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8160fad5-0381-4451-86f3-7891143b854f req-25be7de3-52c2-4526-916c-86721f8d5a02 service nova] Acquired lock "refresh_cache-cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.network.neutron [req-8160fad5-0381-4451-86f3-7891143b854f req-25be7de3-52c2-4526-916c-86721f8d5a02 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Refreshing network info cache for port 7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Start _get_guest_xml network_info=[{"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:41:11 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:11 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-236347244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-236347244',id=24,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-3i88zu0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:41:09Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:c0,bridge_name='br-int',has_traffic_filtering=True,id=7be9bad0-818f-4a3c-a268-eee73dca9d13,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9bad0-81') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.objects.instance [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'pci_devices' on Instance uuid cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:41:11 user nova-compute[75239]:   <uuid>cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3</uuid>
Nov 13 20:41:11 user nova-compute[75239]:   <name>instance-00000018</name>
Nov 13 20:41:11 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:41:11 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:41:11 user nova-compute[75239]:   <metadata>
Nov 13 20:41:11 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:41:11 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:41:11 user nova-compute[75239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-236347244</nova:name>
Nov 13 20:41:11 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:41:11</nova:creationTime>
Nov 13 20:41:11 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:41:11 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:41:11 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:41:11 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:41:11 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:41:11 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:41:11 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:41:11 user nova-compute[75239]:       <nova:owner>
Nov 13 20:41:11 user nova-compute[75239]:         <nova:user uuid="2669d647fe6f4034bc70703546345eb3">tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member</nova:user>
Nov 13 20:41:11 user nova-compute[75239]:         <nova:project uuid="f465510aec2849dfb0917120a772f066">tempest-ServerBootFromVolumeStableRescueTest-2033691872</nova:project>
Nov 13 20:41:11 user nova-compute[75239]:       </nova:owner>
Nov 13 20:41:11 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:41:11 user nova-compute[75239]:       <nova:ports>
Nov 13 20:41:11 user nova-compute[75239]:         <nova:port uuid="7be9bad0-818f-4a3c-a268-eee73dca9d13">
Nov 13 20:41:11 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:41:11 user nova-compute[75239]:         </nova:port>
Nov 13 20:41:11 user nova-compute[75239]:       </nova:ports>
Nov 13 20:41:11 user nova-compute[75239]:     </nova:instance>
Nov 13 20:41:11 user nova-compute[75239]:   </metadata>
Nov 13 20:41:11 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:41:11 user nova-compute[75239]:     <system>
Nov 13 20:41:11 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:41:11 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:41:11 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:41:11 user nova-compute[75239]:       <entry name="serial">cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3</entry>
Nov 13 20:41:11 user nova-compute[75239]:       <entry name="uuid">cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3</entry>
Nov 13 20:41:11 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:41:11 user nova-compute[75239]:     </system>
Nov 13 20:41:11 user nova-compute[75239]:   </sysinfo>
Nov 13 20:41:11 user nova-compute[75239]:   <os>
Nov 13 20:41:11 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:41:11 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:41:11 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:41:11 user nova-compute[75239]:   </os>
Nov 13 20:41:11 user nova-compute[75239]:   <features>
Nov 13 20:41:11 user nova-compute[75239]:     <acpi/>
Nov 13 20:41:11 user nova-compute[75239]:     <apic/>
Nov 13 20:41:11 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:41:11 user nova-compute[75239]:   </features>
Nov 13 20:41:11 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:41:11 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:41:11 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:41:11 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:41:11 user nova-compute[75239]:   </clock>
Nov 13 20:41:11 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:41:11 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:41:11 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:41:11 user nova-compute[75239]:   </cpu>
Nov 13 20:41:11 user nova-compute[75239]:   <devices>
Nov 13 20:41:11 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:41:11 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:41:11 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk"/>
Nov 13 20:41:11 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:41:11 user nova-compute[75239]:     </disk>
Nov 13 20:41:11 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:41:11 user nova-compute[75239]:       <mac address="fa:16:3e:c6:2c:c0"/>
Nov 13 20:41:11 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:41:11 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:41:11 user nova-compute[75239]:       <target dev="tap7be9bad0-81"/>
Nov 13 20:41:11 user nova-compute[75239]:     </interface>
Nov 13 20:41:11 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:41:11 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/console.log" append="off"/>
Nov 13 20:41:11 user nova-compute[75239]:     </serial>
Nov 13 20:41:11 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:41:11 user nova-compute[75239]:     <video>
Nov 13 20:41:11 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:41:11 user nova-compute[75239]:     </video>
Nov 13 20:41:11 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:41:11 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:41:11 user nova-compute[75239]:     </rng>
Nov 13 20:41:11 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:41:11 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:41:11 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:41:11 user nova-compute[75239]:     </memballoon>
Nov 13 20:41:11 user nova-compute[75239]:   </devices>
Nov 13 20:41:11 user nova-compute[75239]: </domain>
Nov 13 20:41:11 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-236347244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-236347244',id=24,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-3i88zu0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:41:09Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:c0,bridge_name='br-int',has_traffic_filtering=True,id=7be9bad0-818f-4a3c-a268-eee73dca9d13,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9bad0-81') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG os_vif [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:c0,bridge_name='br-int',has_traffic_filtering=True,id=7be9bad0-818f-4a3c-a268-eee73dca9d13,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9bad0-81') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71c548e4-04d8-5013-ae87-1393ef6f4582', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7be9bad0-81, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7be9bad0-81, col_values=(('qos', UUID('2f44b2b2-9999-4cdc-b943-47044802fdab')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7be9bad0-81, col_values=(('external_ids', {'iface-id': '7be9bad0-818f-4a3c-a268-eee73dca9d13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:2c:c0', 'vm-uuid': 'cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:11 user nova-compute[75239]: INFO os_vif [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:c0,bridge_name='br-int',has_traffic_filtering=True,id=7be9bad0-818f-4a3c-a268-eee73dca9d13,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9bad0-81')
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No VIF found with MAC fa:16:3e:c6:2c:c0, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.network.neutron [req-8160fad5-0381-4451-86f3-7891143b854f req-25be7de3-52c2-4526-916c-86721f8d5a02 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Updated VIF entry in instance network info cache for port 7be9bad0-818f-4a3c-a268-eee73dca9d13. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG nova.network.neutron [req-8160fad5-0381-4451-86f3-7891143b854f req-25be7de3-52c2-4526-916c-86721f8d5a02 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Updating instance_info_cache with network_info: [{"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:41:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8160fad5-0381-4451-86f3-7891143b854f req-25be7de3-52c2-4526-916c-86721f8d5a02 service nova] Releasing lock "refresh_cache-cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:41:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:12 user nova-compute[75239]: INFO nova.compute.manager [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Detaching volume f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:41:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:12 user nova-compute[75239]: INFO nova.virt.block_device [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Attempting to driver detach volume f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d from mountpoint /dev/vdb
Nov 13 20:41:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Attempting to detach device vdb from instance 55f96b7f-454c-440a-9c78-f91305569e87 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:41:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:41:12 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:41:12 user nova-compute[75239]:   <source dev="/dev/sdi"/>
Nov 13 20:41:12 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:41:12 user nova-compute[75239]:   <serial>f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d</serial>
Nov 13 20:41:12 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 20:41:12 user nova-compute[75239]: </disk>
Nov 13 20:41:12 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:41:12 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully detached device vdb from instance 55f96b7f-454c-440a-9c78-f91305569e87 from the persistent domain config.
Nov 13 20:41:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55f96b7f-454c-440a-9c78-f91305569e87 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:41:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:41:12 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:41:12 user nova-compute[75239]:   <source dev="/dev/sdi"/>
Nov 13 20:41:12 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:41:12 user nova-compute[75239]:   <serial>f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d</serial>
Nov 13 20:41:12 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 20:41:12 user nova-compute[75239]: </disk>
Nov 13 20:41:12 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:41:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:13 user nova-compute[75239]: INFO nova.compute.manager [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Detaching volume 60d6ec51-4db8-41b9-ad00-2637e6d888dc
Nov 13 20:41:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55f96b7f-454c-440a-9c78-f91305569e87 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:41:13 user nova-compute[75239]: INFO nova.virt.block_device [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Attempting to driver detach volume 60d6ec51-4db8-41b9-ad00-2637e6d888dc from mountpoint /dev/vdc
Nov 13 20:41:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Attempting to detach device vdc from instance c3f6a68e-f57c-463f-81fd-e4e047421d5b from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:41:13 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:41:13 user nova-compute[75239]:   <source dev="/dev/sdj"/>
Nov 13 20:41:13 user nova-compute[75239]:   <target dev="vdc" bus="virtio"/>
Nov 13 20:41:13 user nova-compute[75239]:   <serial>60d6ec51-4db8-41b9-ad00-2637e6d888dc</serial>
Nov 13 20:41:13 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 20:41:13 user nova-compute[75239]: </disk>
Nov 13 20:41:13 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:41:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully detached device vdc from instance c3f6a68e-f57c-463f-81fd-e4e047421d5b from the persistent domain config.
Nov 13 20:41:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c3f6a68e-f57c-463f-81fd-e4e047421d5b from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:41:13 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:41:13 user nova-compute[75239]:   <source dev="/dev/sdj"/>
Nov 13 20:41:13 user nova-compute[75239]:   <target dev="vdc" bus="virtio"/>
Nov 13 20:41:13 user nova-compute[75239]:   <serial>60d6ec51-4db8-41b9-ad00-2637e6d888dc</serial>
Nov 13 20:41:13 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 20:41:13 user nova-compute[75239]: </disk>
Nov 13 20:41:13 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:41:13 user nova-compute[75239]: INFO nova.compute.claims [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Claim successful on node user
Nov 13 20:41:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG nova.network.neutron [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:41:14 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:41:14 user nova-compute[75239]: DEBUG nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG nova.policy [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6abaa983d703498f9bcd47764794423c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd8f58057142af8d76c28d6b7b70c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:41:14 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Creating image(s)
Nov 13 20:41:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "/opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "/opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "b5b056ba05aca26f288cc4b254eb610dad6bd84c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "b5b056ba05aca26f288cc4b254eb610dad6bd84c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-369b0cc5-0f47-43fd-a3c1-f9fdbc35028b req-b28a976a-2906-4bb3-a44e-3fc7dbfa59b3 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received event network-vif-plugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-369b0cc5-0f47-43fd-a3c1-f9fdbc35028b req-b28a976a-2906-4bb3-a44e-3fc7dbfa59b3 service nova] Acquiring lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-369b0cc5-0f47-43fd-a3c1-f9fdbc35028b req-b28a976a-2906-4bb3-a44e-3fc7dbfa59b3 service nova] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-369b0cc5-0f47-43fd-a3c1-f9fdbc35028b req-b28a976a-2906-4bb3-a44e-3fc7dbfa59b3 service nova] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-369b0cc5-0f47-43fd-a3c1-f9fdbc35028b req-b28a976a-2906-4bb3-a44e-3fc7dbfa59b3 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] No waiting events found dispatching network-vif-plugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:15 user nova-compute[75239]: WARNING nova.compute.manager [req-369b0cc5-0f47-43fd-a3c1-f9fdbc35028b req-b28a976a-2906-4bb3-a44e-3fc7dbfa59b3 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received unexpected event network-vif-plugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 for instance with vm_state building and task_state spawning.
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:41:15 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Instance spawned successfully.
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c.part --force-share --output=json" returned: 0 in 0.219s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:15 user nova-compute[75239]: INFO nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.virt.images [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] 8b0c7e2a-f1d7-414a-9bb2-4120ee884b26 was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c.part /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Successfully created port: f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:41:15 user nova-compute[75239]: INFO nova.compute.manager [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Took 6.86 seconds to build instance.
Nov 13 20:41:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bcf92e66-c7ee-48c2-a74d-586b17dd388c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.106s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c.part /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c.converted" returned: 0 in 0.433s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "b5b056ba05aca26f288cc4b254eb610dad6bd84c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.486s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG nova.network.neutron [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Successfully updated port: f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquired lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG nova.network.neutron [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c --force-share --output=json" returned: 0 in 0.212s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "b5b056ba05aca26f288cc4b254eb610dad6bd84c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "b5b056ba05aca26f288cc4b254eb610dad6bd84c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG nova.network.neutron [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c --force-share --output=json" returned: 0 in 0.249s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c,backing_fmt=raw /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c,backing_fmt=raw /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk 1073741824" returned: 0 in 0.067s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "b5b056ba05aca26f288cc4b254eb610dad6bd84c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG nova.network.neutron [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating instance_info_cache with network_info: [{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Releasing lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Instance network_info: |[{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c --force-share --output=json" returned: 0 in 0.218s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:41:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Cannot resize image /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Ensure instance console log exists: /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Start _get_guest_xml network_info=[{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:41:10Z,direct_url=<?>,disk_format='qcow2',id=8b0c7e2a-f1d7-414a-9bb2-4120ee884b26,min_disk=0,min_ram=0,name='tempest-scenario-img--987290224',owner='53fd8f58057142af8d76c28d6b7b70c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:41:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '8b0c7e2a-f1d7-414a-9bb2-4120ee884b26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:41:17 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:17 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received event network-vif-plugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] Acquiring lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] No waiting events found dispatching network-vif-plugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:17 user nova-compute[75239]: WARNING nova.compute.manager [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received unexpected event network-vif-plugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 for instance with vm_state active and task_state None.
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing instance network info cache due to event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] Acquiring lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] Acquired lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.network.neutron [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:41:10Z,direct_url=<?>,disk_format='qcow2',id=8b0c7e2a-f1d7-414a-9bb2-4120ee884b26,min_disk=0,min_ram=0,name='tempest-scenario-img--987290224',owner='53fd8f58057142af8d76c28d6b7b70c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:41:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-449964227',display_name='tempest-TestMinimumBasicScenario-server-449964227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-449964227',id=25,image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp/zymYPzrC2cq/ApuPEOrcNJO47mKCagQFITBK4Xp20X9/7JqHfiUue4O7ur0brcNWAVqhJ6uBAft/viDg76a6W2C7ikxLv/XhEx5XTImMpMM/zOG1KHdX6M5OEb7AzQ==',key_name='tempest-TestMinimumBasicScenario-1764874526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53fd8f58057142af8d76c28d6b7b70c6',ramdisk_id='',reservation_id='r-4exsmb4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-168427819',owner_user_name='tempest-TestMinimumBasicScenario-168427819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:41:15Z,user_data=None,user_id='6abaa983d703498f9bcd47764794423c',uuid=ac9ac0ae-2f54-4130-aefa-17e7d36a5621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converting VIF {"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.objects.instance [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'pci_devices' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:41:17 user nova-compute[75239]:   <uuid>ac9ac0ae-2f54-4130-aefa-17e7d36a5621</uuid>
Nov 13 20:41:17 user nova-compute[75239]:   <name>instance-00000019</name>
Nov 13 20:41:17 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:41:17 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:41:17 user nova-compute[75239]:   <metadata>
Nov 13 20:41:17 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:41:17 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:41:17 user nova-compute[75239]:       <nova:name>tempest-TestMinimumBasicScenario-server-449964227</nova:name>
Nov 13 20:41:17 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:41:17</nova:creationTime>
Nov 13 20:41:17 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:41:17 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:41:17 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:41:17 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:41:17 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:41:17 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:41:17 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:41:17 user nova-compute[75239]:       <nova:owner>
Nov 13 20:41:17 user nova-compute[75239]:         <nova:user uuid="6abaa983d703498f9bcd47764794423c">tempest-TestMinimumBasicScenario-168427819-project-member</nova:user>
Nov 13 20:41:17 user nova-compute[75239]:         <nova:project uuid="53fd8f58057142af8d76c28d6b7b70c6">tempest-TestMinimumBasicScenario-168427819</nova:project>
Nov 13 20:41:17 user nova-compute[75239]:       </nova:owner>
Nov 13 20:41:17 user nova-compute[75239]:       <nova:root type="image" uuid="8b0c7e2a-f1d7-414a-9bb2-4120ee884b26"/>
Nov 13 20:41:17 user nova-compute[75239]:       <nova:ports>
Nov 13 20:41:17 user nova-compute[75239]:         <nova:port uuid="f5265dee-cd51-48a3-8c95-5b0b70e90e1f">
Nov 13 20:41:17 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 20:41:17 user nova-compute[75239]:         </nova:port>
Nov 13 20:41:17 user nova-compute[75239]:       </nova:ports>
Nov 13 20:41:17 user nova-compute[75239]:     </nova:instance>
Nov 13 20:41:17 user nova-compute[75239]:   </metadata>
Nov 13 20:41:17 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:41:17 user nova-compute[75239]:     <system>
Nov 13 20:41:17 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:41:17 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:41:17 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:41:17 user nova-compute[75239]:       <entry name="serial">ac9ac0ae-2f54-4130-aefa-17e7d36a5621</entry>
Nov 13 20:41:17 user nova-compute[75239]:       <entry name="uuid">ac9ac0ae-2f54-4130-aefa-17e7d36a5621</entry>
Nov 13 20:41:17 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:41:17 user nova-compute[75239]:     </system>
Nov 13 20:41:17 user nova-compute[75239]:   </sysinfo>
Nov 13 20:41:17 user nova-compute[75239]:   <os>
Nov 13 20:41:17 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:41:17 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:41:17 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:41:17 user nova-compute[75239]:   </os>
Nov 13 20:41:17 user nova-compute[75239]:   <features>
Nov 13 20:41:17 user nova-compute[75239]:     <acpi/>
Nov 13 20:41:17 user nova-compute[75239]:     <apic/>
Nov 13 20:41:17 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:41:17 user nova-compute[75239]:   </features>
Nov 13 20:41:17 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:41:17 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:41:17 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:41:17 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:41:17 user nova-compute[75239]:   </clock>
Nov 13 20:41:17 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:41:17 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:41:17 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:41:17 user nova-compute[75239]:   </cpu>
Nov 13 20:41:17 user nova-compute[75239]:   <devices>
Nov 13 20:41:17 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:41:17 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:41:17 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk"/>
Nov 13 20:41:17 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:41:17 user nova-compute[75239]:     </disk>
Nov 13 20:41:17 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:41:17 user nova-compute[75239]:       <mac address="fa:16:3e:b3:7c:48"/>
Nov 13 20:41:17 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:41:17 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:41:17 user nova-compute[75239]:       <target dev="tapf5265dee-cd"/>
Nov 13 20:41:17 user nova-compute[75239]:     </interface>
Nov 13 20:41:17 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:41:17 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/console.log" append="off"/>
Nov 13 20:41:17 user nova-compute[75239]:     </serial>
Nov 13 20:41:17 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:41:17 user nova-compute[75239]:     <video>
Nov 13 20:41:17 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:41:17 user nova-compute[75239]:     </video>
Nov 13 20:41:17 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:41:17 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:41:17 user nova-compute[75239]:     </rng>
Nov 13 20:41:17 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:41:17 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:41:17 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:41:17 user nova-compute[75239]:     </memballoon>
Nov 13 20:41:17 user nova-compute[75239]:   </devices>
Nov 13 20:41:17 user nova-compute[75239]: </domain>
Nov 13 20:41:17 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-449964227',display_name='tempest-TestMinimumBasicScenario-server-449964227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-449964227',id=25,image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp/zymYPzrC2cq/ApuPEOrcNJO47mKCagQFITBK4Xp20X9/7JqHfiUue4O7ur0brcNWAVqhJ6uBAft/viDg76a6W2C7ikxLv/XhEx5XTImMpMM/zOG1KHdX6M5OEb7AzQ==',key_name='tempest-TestMinimumBasicScenario-1764874526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53fd8f58057142af8d76c28d6b7b70c6',ramdisk_id='',reservation_id='r-4exsmb4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-168427819',owner_user_name='tempest-TestMinimumBasicScenario-168427819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:41:15Z,user_data=None,user_id='6abaa983d703498f9bcd47764794423c',uuid=ac9ac0ae-2f54-4130-aefa-17e7d36a5621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converting VIF {"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG os_vif [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83e8cd05-f7ca-5d96-a084-0538ab14c1f4', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5265dee-cd, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5265dee-cd, col_values=(('qos', UUID('7179d8db-c318-4e3d-bab1-7026adb33964')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5265dee-cd, col_values=(('external_ids', {'iface-id': 'f5265dee-cd51-48a3-8c95-5b0b70e90e1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:7c:48', 'vm-uuid': 'ac9ac0ae-2f54-4130-aefa-17e7d36a5621'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:17 user nova-compute[75239]: INFO os_vif [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd')
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No VIF found with MAC fa:16:3e:b3:7c:48, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.network.neutron [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updated VIF entry in instance network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG nova.network.neutron [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating instance_info_cache with network_info: [{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b47bad7-45a1-48ff-8f9a-116eb1124437 req-e210d4e0-5c39-4cce-8c75-285228453b36 service nova] Releasing lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:41:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-55ee67a5-b40b-48f6-8285-7f37dc7e23a1 req-bfc6a739-5bb0-4faa-9caf-ffcaca382e51 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-55ee67a5-b40b-48f6-8285-7f37dc7e23a1 req-bfc6a739-5bb0-4faa-9caf-ffcaca382e51 service nova] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-55ee67a5-b40b-48f6-8285-7f37dc7e23a1 req-bfc6a739-5bb0-4faa-9caf-ffcaca382e51 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-55ee67a5-b40b-48f6-8285-7f37dc7e23a1 req-bfc6a739-5bb0-4faa-9caf-ffcaca382e51 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-55ee67a5-b40b-48f6-8285-7f37dc7e23a1 req-bfc6a739-5bb0-4faa-9caf-ffcaca382e51 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] No waiting events found dispatching network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:19 user nova-compute[75239]: WARNING nova.compute.manager [req-55ee67a5-b40b-48f6-8285-7f37dc7e23a1 req-bfc6a739-5bb0-4faa-9caf-ffcaca382e51 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received unexpected event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f for instance with vm_state building and task_state spawning.
Nov 13 20:41:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-3598474b-5cab-428f-a14e-7e53d20d4eca req-475429f1-da76-4e90-8fdc-ab53d11a78ab service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3598474b-5cab-428f-a14e-7e53d20d4eca req-475429f1-da76-4e90-8fdc-ab53d11a78ab service nova] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3598474b-5cab-428f-a14e-7e53d20d4eca req-475429f1-da76-4e90-8fdc-ab53d11a78ab service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3598474b-5cab-428f-a14e-7e53d20d4eca req-475429f1-da76-4e90-8fdc-ab53d11a78ab service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-3598474b-5cab-428f-a14e-7e53d20d4eca req-475429f1-da76-4e90-8fdc-ab53d11a78ab service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] No waiting events found dispatching network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:21 user nova-compute[75239]: WARNING nova.compute.manager [req-3598474b-5cab-428f-a14e-7e53d20d4eca req-475429f1-da76-4e90-8fdc-ab53d11a78ab service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received unexpected event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f for instance with vm_state building and task_state spawning.
Nov 13 20:41:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:41:21 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Instance spawned successfully.
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:21 user nova-compute[75239]: INFO nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Took 7.09 seconds to spawn the instance on the hypervisor.
Nov 13 20:41:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:41:21 user nova-compute[75239]: INFO nova.compute.manager [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Took 7.97 seconds to build instance.
Nov 13 20:41:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-443479bb-cd5c-4d7e-b60f-6ed373f768db tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.077s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:26 user nova-compute[75239]: INFO nova.compute.manager [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Rescuing
Nov 13 20:41:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:41:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquired lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:41:26 user nova-compute[75239]: DEBUG nova.network.neutron [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG nova.network.neutron [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updating instance_info_cache with network_info: [{"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Releasing lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ffe3b90-1ee8-4f41-a757-773054d7bab5 req-799658b6-2dc3-4217-8eb7-6dcc0c168d14 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-unplugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ffe3b90-1ee8-4f41-a757-773054d7bab5 req-799658b6-2dc3-4217-8eb7-6dcc0c168d14 service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ffe3b90-1ee8-4f41-a757-773054d7bab5 req-799658b6-2dc3-4217-8eb7-6dcc0c168d14 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ffe3b90-1ee8-4f41-a757-773054d7bab5 req-799658b6-2dc3-4217-8eb7-6dcc0c168d14 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ffe3b90-1ee8-4f41-a757-773054d7bab5 req-799658b6-2dc3-4217-8eb7-6dcc0c168d14 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-unplugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:27 user nova-compute[75239]: WARNING nova.compute.manager [req-8ffe3b90-1ee8-4f41-a757-773054d7bab5 req-799658b6-2dc3-4217-8eb7-6dcc0c168d14 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-unplugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state active and task_state rescuing.
Nov 13 20:41:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Instance destroyed successfully.
Nov 13 20:41:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Attempting rescue
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Instance directory exists: not creating {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 20:41:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Creating image(s)
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue" returned: 0 in 0.054s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'migration_context' on Instance uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.base [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<4ca1da31-616b-4f78-b50b-6e58d8d70974> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Start _get_guest_xml network_info=[{"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "vif_mac": "fa:16:3e:1b:ec:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'resources' on Instance uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.base [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<4ca1da31-616b-4f78-b50b-6e58d8d70974> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'numa_topology' on Instance uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.base [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<4ca1da31-616b-4f78-b50b-6e58d8d70974> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:41:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.base [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<4ca1da31-616b-4f78-b50b-6e58d8d70974> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-760259817',display_name='tempest-ServerRescueNegativeTestJSON-server-760259817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-760259817',id=17,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:36:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-n3bmobey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:36:53Z,user_data=None,user_id='b27083a4000d4ba2832a394b9140b530',uuid=4ca1da31-616b-4f78-b50b-6e58d8d70974,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "vif_mac": "fa:16:3e:1b:ec:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "vif_mac": "fa:16:3e:1b:ec:16"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=b2ae89b4-c188-415f-96da-bb22e699bc22,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ae89b4-c1') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.objects.base [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<4ca1da31-616b-4f78-b50b-6e58d8d70974> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:41:28 user nova-compute[75239]:   <uuid>4ca1da31-616b-4f78-b50b-6e58d8d70974</uuid>
Nov 13 20:41:28 user nova-compute[75239]:   <name>instance-00000011</name>
Nov 13 20:41:28 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:41:28 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:41:28 user nova-compute[75239]:   <metadata>
Nov 13 20:41:28 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:41:28 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:41:28 user nova-compute[75239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-760259817</nova:name>
Nov 13 20:41:28 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:41:28</nova:creationTime>
Nov 13 20:41:28 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:41:28 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:41:28 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:41:28 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:41:28 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:41:28 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:41:28 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:41:28 user nova-compute[75239]:       <nova:owner>
Nov 13 20:41:28 user nova-compute[75239]:         <nova:user uuid="b27083a4000d4ba2832a394b9140b530">tempest-ServerRescueNegativeTestJSON-1212200086-project-member</nova:user>
Nov 13 20:41:28 user nova-compute[75239]:         <nova:project uuid="41532512e3494bfd9051c340c2557bfe">tempest-ServerRescueNegativeTestJSON-1212200086</nova:project>
Nov 13 20:41:28 user nova-compute[75239]:       </nova:owner>
Nov 13 20:41:28 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:41:28 user nova-compute[75239]:       <nova:ports>
Nov 13 20:41:28 user nova-compute[75239]:         <nova:port uuid="b2ae89b4-c188-415f-96da-bb22e699bc22">
Nov 13 20:41:28 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 20:41:28 user nova-compute[75239]:         </nova:port>
Nov 13 20:41:28 user nova-compute[75239]:       </nova:ports>
Nov 13 20:41:28 user nova-compute[75239]:     </nova:instance>
Nov 13 20:41:28 user nova-compute[75239]:   </metadata>
Nov 13 20:41:28 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:41:28 user nova-compute[75239]:     <system>
Nov 13 20:41:28 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:41:28 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:41:28 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:41:28 user nova-compute[75239]:       <entry name="serial">4ca1da31-616b-4f78-b50b-6e58d8d70974</entry>
Nov 13 20:41:28 user nova-compute[75239]:       <entry name="uuid">4ca1da31-616b-4f78-b50b-6e58d8d70974</entry>
Nov 13 20:41:28 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:41:28 user nova-compute[75239]:     </system>
Nov 13 20:41:28 user nova-compute[75239]:   </sysinfo>
Nov 13 20:41:28 user nova-compute[75239]:   <os>
Nov 13 20:41:28 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:41:28 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:41:28 user nova-compute[75239]:   </os>
Nov 13 20:41:28 user nova-compute[75239]:   <features>
Nov 13 20:41:28 user nova-compute[75239]:     <acpi/>
Nov 13 20:41:28 user nova-compute[75239]:     <apic/>
Nov 13 20:41:28 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:41:28 user nova-compute[75239]:   </features>
Nov 13 20:41:28 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:41:28 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:41:28 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:41:28 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:41:28 user nova-compute[75239]:   </clock>
Nov 13 20:41:28 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:41:28 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:41:28 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:41:28 user nova-compute[75239]:   </cpu>
Nov 13 20:41:28 user nova-compute[75239]:   <devices>
Nov 13 20:41:28 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:41:28 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:41:28 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue"/>
Nov 13 20:41:28 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:41:28 user nova-compute[75239]:     </disk>
Nov 13 20:41:28 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:41:28 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:41:28 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk"/>
Nov 13 20:41:28 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:41:28 user nova-compute[75239]:     </disk>
Nov 13 20:41:28 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:41:28 user nova-compute[75239]:       <mac address="fa:16:3e:1b:ec:16"/>
Nov 13 20:41:28 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:41:28 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:41:28 user nova-compute[75239]:       <target dev="tapb2ae89b4-c1"/>
Nov 13 20:41:28 user nova-compute[75239]:     </interface>
Nov 13 20:41:28 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:41:28 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/console.log" append="off"/>
Nov 13 20:41:28 user nova-compute[75239]:     </serial>
Nov 13 20:41:28 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:41:28 user nova-compute[75239]:     <video>
Nov 13 20:41:28 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:41:28 user nova-compute[75239]:     </video>
Nov 13 20:41:28 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:41:28 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:41:28 user nova-compute[75239]:     </rng>
Nov 13 20:41:28 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:41:28 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:41:28 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:41:28 user nova-compute[75239]:     </memballoon>
Nov 13 20:41:28 user nova-compute[75239]:   </devices>
Nov 13 20:41:28 user nova-compute[75239]: </domain>
Nov 13 20:41:28 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:41:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Instance destroyed successfully.
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:41:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No VIF found with MAC fa:16:3e:1b:ec:16, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:41:29 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:41:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-56abde7e-7538-478c-8b6c-f80460aaf582 req-427e72ef-d7eb-488a-8f2a-01924d4af071 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-56abde7e-7538-478c-8b6c-f80460aaf582 req-427e72ef-d7eb-488a-8f2a-01924d4af071 service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-56abde7e-7538-478c-8b6c-f80460aaf582 req-427e72ef-d7eb-488a-8f2a-01924d4af071 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-56abde7e-7538-478c-8b6c-f80460aaf582 req-427e72ef-d7eb-488a-8f2a-01924d4af071 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-56abde7e-7538-478c-8b6c-f80460aaf582 req-427e72ef-d7eb-488a-8f2a-01924d4af071 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:29 user nova-compute[75239]: WARNING nova.compute.manager [req-56abde7e-7538-478c-8b6c-f80460aaf582 req-427e72ef-d7eb-488a-8f2a-01924d4af071 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state active and task_state rescuing.
Nov 13 20:41:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-8a8ba647-aa9c-4483-82a7-c30fa78688e3 req-f77b47b5-6167-4dd8-a982-06270be6f4a8 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-changed-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-8a8ba647-aa9c-4483-82a7-c30fa78688e3 req-f77b47b5-6167-4dd8-a982-06270be6f4a8 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Refreshing instance network info cache due to event network-changed-112c3460-96e2-4760-b161-d7a6fd9b3535. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8a8ba647-aa9c-4483-82a7-c30fa78688e3 req-f77b47b5-6167-4dd8-a982-06270be6f4a8 service nova] Acquiring lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8a8ba647-aa9c-4483-82a7-c30fa78688e3 req-f77b47b5-6167-4dd8-a982-06270be6f4a8 service nova] Acquired lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG nova.network.neutron [req-8a8ba647-aa9c-4483-82a7-c30fa78688e3 req-f77b47b5-6167-4dd8-a982-06270be6f4a8 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Refreshing network info cache for port 112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:31 user nova-compute[75239]: WARNING nova.compute.manager [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state active and task_state rescuing.
Nov 13 20:41:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:31 user nova-compute[75239]: WARNING nova.compute.manager [req-f493e523-ea23-44a9-948c-0445dca317cd req-80ddd5c9-8adc-46e8-b8d8-223508fb80d4 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state active and task_state rescuing.
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG nova.network.neutron [req-8a8ba647-aa9c-4483-82a7-c30fa78688e3 req-f77b47b5-6167-4dd8-a982-06270be6f4a8 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updated VIF entry in instance network info cache for port 112c3460-96e2-4760-b161-d7a6fd9b3535. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG nova.network.neutron [req-8a8ba647-aa9c-4483-82a7-c30fa78688e3 req-f77b47b5-6167-4dd8-a982-06270be6f4a8 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating instance_info_cache with network_info: [{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8a8ba647-aa9c-4483-82a7-c30fa78688e3 req-f77b47b5-6167-4dd8-a982-06270be6f4a8 service nova] Releasing lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-e9729159-3961-4a3e-bbba-160162a6e0de tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:41:33 user nova-compute[75239]: INFO nova.compute.claims [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Claim successful on node user
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 55f96b7f-454c-440a-9c78-f91305569e87 is timed out.
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully detached device vdb from instance 55f96b7f-454c-440a-9c78-f91305569e87 from the live domain config.
Nov 13 20:41:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'USVaEvyj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:41:33 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[665aedbc-c86a-4074-9c6e-49cd03dc7026]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:41:33 user nova-compute[75239]: No targets found.
Nov 13 20:41:33 user nova-compute[75239]: iSNS:
Nov 13 20:41:33 user nova-compute[75239]: No targets found.
Nov 13 20:41:33 user nova-compute[75239]: STATIC:
Nov 13 20:41:33 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:41:33 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:41:33 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:41:33 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d
Nov 13 20:41:33 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:41:33 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:41:33 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc
Nov 13 20:41:33 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:41:33 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:41:33 user nova-compute[75239]: FIRMWARE:
Nov 13 20:41:33 user nova-compute[75239]: No targets found.
Nov 13 20:41:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:41:33 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:41:33 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[703f56c7-91d6-464b-8d7a-c510c9a1bdbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5380cee3-3590-43db-b8a0-383449af8aeb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:41:33 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:41:33 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:41:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:41:33 user nova-compute[75239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d (non-flash)
Nov 13 20:41:33 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:41:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d84288f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d'): ({'sdi'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Removing single pathed devices sdi {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[55befbe6-7ab0-46a5-b7c7-ac8752609be9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7ffa11-ed9b-44ea-8a78-4f0645ebf0ea]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flushing IO for device /dev/sdi {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[20596c39-633f-4fd5-95a9-9d75854e6aa8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.057s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a7f290-d64f-4d8b-9df2-45822d2ce83c]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] SCSI volumes sdi have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2d27b2-074a-45c0-a078-812a6aeb3768]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[079e71ec-1e2a-4dfd-83f4-e47dd781ec01]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260]
Nov 13 20:41:33 user nova-compute[75239]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d, portal: 172.16.0.220,3260] successful.
Nov 13 20:41:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8db5d24-0ca4-408f-9f6b-1c63fe47bc3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0116b7e7-0331-4576-9ef5-bb3d594da666]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== disconnect_volume: return (456ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:41:33 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c3f6a68e-f57c-463f-81fd-e4e047421d5b is timed out.
Nov 13 20:41:33 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully detached device vdc from instance c3f6a68e-f57c-463f-81fd-e4e047421d5b from the live domain config.
Nov 13 20:41:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OtNaVeKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:41:33 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f40b364-9bb7-4a24-869a-40a2edb08f33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:41:33 user nova-compute[75239]: No targets found.
Nov 13 20:41:33 user nova-compute[75239]: iSNS:
Nov 13 20:41:33 user nova-compute[75239]: No targets found.
Nov 13 20:41:33 user nova-compute[75239]: STATIC:
Nov 13 20:41:33 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:41:33 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:41:33 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:41:33 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc
Nov 13 20:41:33 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:41:33 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:41:33 user nova-compute[75239]: FIRMWARE:
Nov 13 20:41:33 user nova-compute[75239]: No targets found.
Nov 13 20:41:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:41:33 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:41:33 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[24112085-893f-472a-b805-72fe2b16b9ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7197bd-70ad-46b3-984d-1ab63f786886]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.857s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:41:34 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:41:34 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:41:34 user nova-compute[75239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc (non-flash)
Nov 13 20:41:34 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605acf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc'): ({'sdj'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Removing single pathed devices sdj {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd869c5-682a-413f-b0fa-0eb4a95988c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG nova.network.neutron [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec8ef8-8b4f-4fe8-a280-0419a9949856]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Flushing IO for device /dev/sdj {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:41:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d4fd75-5573-4882-89ce-21b8ee20447d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.047s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b1f726-f57a-495d-81f1-acda5c7a963a]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] SCSI volumes sdj have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:41:34 user nova-compute[75239]: INFO nova.virt.block_device [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Booting with volume c41538ee-cd29-4af9-b597-09cfc25852c6 at /dev/vda
Nov 13 20:41:34 user nova-compute[75239]: DEBUG nova.policy [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41ee3d20cab9440d9564a3b536668fda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4a480ab579c451799fbaac4af653379', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585817d-fd83-49df-9da7-d0934c49e934]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.utils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf1abe-2e09-4fd6-9303-262514ad548f]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc, portal: 172.16.0.220,3260]
Nov 13 20:41:34 user nova-compute[75239]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc, portal: 172.16.0.220,3260] successful.
Nov 13 20:41:34 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3fc2dd-01f3-446e-bb1c-b8a393b77d23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60d6ec51-4db8-41b9-ad00-2637e6d888dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[843ac239-0367-421c-b658-f427fed9d5d8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.530s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] <== disconnect_volume: return (533ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1245ca92-0825-448c-acff-4d0ed1f5403a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[902c8ef4-a8a9-44f3-a5c2-94f83a34aa88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e5eb4f-c041-4220-ad13-ffe40a9b2a50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:41:34 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[797afe28-db81-4d07-9b37-8e0ce8d7e877]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG os_brick.utils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] <== get_connector_properties: return (223ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating existing volume attachment record: b5f6f7a8-de4e-474f-9a28-d7b328df472d {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'flavor' on Instance uuid 55f96b7f-454c-440a-9c78-f91305569e87 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8751398d-9d77-4b12-b307-b4e6c0708978 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.238s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Successfully created port: 0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG nova.objects.instance [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'flavor' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95abd0d6-0948-42f4-b931-e99c4a22de4f tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.212s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Successfully updated port: 0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquired lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-84435cf0-a370-4e84-bb27-5e83cc38401a req-4ae6d6e8-bf4e-44c7-9054-0f8f2cbf8dcc service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-84435cf0-a370-4e84-bb27-5e83cc38401a req-4ae6d6e8-bf4e-44c7-9054-0f8f2cbf8dcc service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing instance network info cache due to event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-84435cf0-a370-4e84-bb27-5e83cc38401a req-4ae6d6e8-bf4e-44c7-9054-0f8f2cbf8dcc service nova] Acquiring lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG nova.network.neutron [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Releasing lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Instance network_info: |[{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-84435cf0-a370-4e84-bb27-5e83cc38401a req-4ae6d6e8-bf4e-44c7-9054-0f8f2cbf8dcc service nova] Acquired lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG nova.network.neutron [req-84435cf0-a370-4e84-bb27-5e83cc38401a req-4ae6d6e8-bf4e-44c7-9054-0f8f2cbf8dcc service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:37 user nova-compute[75239]: DEBUG nova.network.neutron [req-84435cf0-a370-4e84-bb27-5e83cc38401a req-4ae6d6e8-bf4e-44c7-9054-0f8f2cbf8dcc service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updated VIF entry in instance network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:41:37 user nova-compute[75239]: DEBUG nova.network.neutron [req-84435cf0-a370-4e84-bb27-5e83cc38401a req-4ae6d6e8-bf4e-44c7-9054-0f8f2cbf8dcc service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:41:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:41:37 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:37 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7232MB free_disk=24.807174682617188GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:41:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-84435cf0-a370-4e84-bb27-5e83cc38401a req-4ae6d6e8-bf4e-44c7-9054-0f8f2cbf8dcc service nova] Releasing lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 55f96b7f-454c-440a-9c78-f91305569e87 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c3f6a68e-f57c-463f-81fd-e4e047421d5b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 0c4645d0-ba7a-4f2b-92fb-401891187489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d6efe568-bf8d-4342-bb0e-0a878f7cccf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:41:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:41:39 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Creating image(s)
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Ensure instance console log exists: /opt/stack/data/nova/instances/d6efe568-bf8d-4342-bb0e-0a878f7cccf3/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Start _get_guest_xml network_info=[{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b5f6f7a8-de4e-474f-9a28-d7b328df472d', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKRGSQhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6efe568-bf8d-4342-bb0e-0a878f7cccf3', 'attached_at': '', 'detached_at': '', 'volume_id': 'c41538ee-cd29-4af9-b597-09cfc25852c6', 'serial': 'c41538ee-cd29-4af9-b597-09cfc25852c6'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:41:39 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:39 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKRGSQhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:41:39 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:41:39 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:41:39 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b192b4a-fec0-468b-ac8a-10c12bc493c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:41:39 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99303b5-6a65-4e06-902a-5d74daebe670]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6] added
Nov 13 20:41:39 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8889159e-9f63-47c6-bb59-89f473d1e4e1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f908d1b-1119-473f-b8e1-5430a776d781]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKRGSQhW {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKRGSQhW" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a819883-7e0e-47b7-9ae3-5721aa9fe83b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKRGSQhW'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1788124c-a330-4433-b4cc-6f5b348d43e8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e072ea-36d6-4de9-891b-922abb08c0b9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:41:39 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:41:39 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca64c417-6738-460a-8097-b3bc67db4a8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260]
Nov 13 20:41:39 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260] successful.
Nov 13 20:41:39 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b723b6c1-a32f-45a2-bf37-c35d46c374a0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[849b782a-4f18-48ad-a72c-b3d739670b00]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:41:39 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:41:39 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:41:39 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:41:39 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadb4204-fd46-4910-b36d-d10a11c8d355]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:41:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKRGSQhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updating instance_info_cache with network_info: [{"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26332316431316130', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332316431316130', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1104629884',display_name='tempest-TestShelveInstance-server-1104629884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1104629884',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIKH+oCJ3NUeycdEu6o0ACiWfJa/kxXrNTIHezDCjZ4hZvwPmJKxpD3DthYAcv9iLh2oZ3SAgjtnpJ0CtwHOrOkHMhfLVc1u+0r3+jR3oH11gC8/uAbwmubEO5JCg7CFQ==',key_name='tempest-TestShelveInstance-438861881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4a480ab579c451799fbaac4af653379',ramdisk_id='',reservation_id='r-febrlktk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1910953819',owner_user_name='tempest-TestShelveInstance-1910953819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:41:34Z,user_data=None,user_id='41ee3d20cab9440d9564a3b536668fda',uuid=d6efe568-bf8d-4342-bb0e-0a878f7cccf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converting VIF {"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.objects.instance [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lazy-loading 'pci_devices' on Instance uuid d6efe568-bf8d-4342-bb0e-0a878f7cccf3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:41:40 user nova-compute[75239]:   <uuid>d6efe568-bf8d-4342-bb0e-0a878f7cccf3</uuid>
Nov 13 20:41:40 user nova-compute[75239]:   <name>instance-0000001a</name>
Nov 13 20:41:40 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:41:40 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:41:40 user nova-compute[75239]:   <metadata>
Nov 13 20:41:40 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:41:40 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:41:40 user nova-compute[75239]:       <nova:name>tempest-TestShelveInstance-server-1104629884</nova:name>
Nov 13 20:41:40 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:41:39</nova:creationTime>
Nov 13 20:41:40 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:41:40 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:41:40 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:41:40 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:41:40 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:41:40 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:41:40 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:41:40 user nova-compute[75239]:       <nova:owner>
Nov 13 20:41:40 user nova-compute[75239]:         <nova:user uuid="41ee3d20cab9440d9564a3b536668fda">tempest-TestShelveInstance-1910953819-project-member</nova:user>
Nov 13 20:41:40 user nova-compute[75239]:         <nova:project uuid="b4a480ab579c451799fbaac4af653379">tempest-TestShelveInstance-1910953819</nova:project>
Nov 13 20:41:40 user nova-compute[75239]:       </nova:owner>
Nov 13 20:41:40 user nova-compute[75239]:       <nova:ports>
Nov 13 20:41:40 user nova-compute[75239]:         <nova:port uuid="0b40e357-282b-4698-9af6-41acd4aa408b">
Nov 13 20:41:40 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 20:41:40 user nova-compute[75239]:         </nova:port>
Nov 13 20:41:40 user nova-compute[75239]:       </nova:ports>
Nov 13 20:41:40 user nova-compute[75239]:     </nova:instance>
Nov 13 20:41:40 user nova-compute[75239]:   </metadata>
Nov 13 20:41:40 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:41:40 user nova-compute[75239]:     <system>
Nov 13 20:41:40 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:41:40 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:41:40 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:41:40 user nova-compute[75239]:       <entry name="serial">d6efe568-bf8d-4342-bb0e-0a878f7cccf3</entry>
Nov 13 20:41:40 user nova-compute[75239]:       <entry name="uuid">d6efe568-bf8d-4342-bb0e-0a878f7cccf3</entry>
Nov 13 20:41:40 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:41:40 user nova-compute[75239]:     </system>
Nov 13 20:41:40 user nova-compute[75239]:   </sysinfo>
Nov 13 20:41:40 user nova-compute[75239]:   <os>
Nov 13 20:41:40 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:41:40 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:41:40 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:41:40 user nova-compute[75239]:   </os>
Nov 13 20:41:40 user nova-compute[75239]:   <features>
Nov 13 20:41:40 user nova-compute[75239]:     <acpi/>
Nov 13 20:41:40 user nova-compute[75239]:     <apic/>
Nov 13 20:41:40 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:41:40 user nova-compute[75239]:   </features>
Nov 13 20:41:40 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:41:40 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:41:40 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:41:40 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:41:40 user nova-compute[75239]:   </clock>
Nov 13 20:41:40 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:41:40 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:41:40 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:41:40 user nova-compute[75239]:   </cpu>
Nov 13 20:41:40 user nova-compute[75239]:   <devices>
Nov 13 20:41:40 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:41:40 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:41:40 user nova-compute[75239]:       <source dev="/dev/sdc"/>
Nov 13 20:41:40 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:41:40 user nova-compute[75239]:       <serial>c41538ee-cd29-4af9-b597-09cfc25852c6</serial>
Nov 13 20:41:40 user nova-compute[75239]:     </disk>
Nov 13 20:41:40 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:41:40 user nova-compute[75239]:       <mac address="fa:16:3e:9d:cb:d3"/>
Nov 13 20:41:40 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:41:40 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:41:40 user nova-compute[75239]:       <target dev="tap0b40e357-28"/>
Nov 13 20:41:40 user nova-compute[75239]:     </interface>
Nov 13 20:41:40 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:41:40 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/d6efe568-bf8d-4342-bb0e-0a878f7cccf3/console.log" append="off"/>
Nov 13 20:41:40 user nova-compute[75239]:     </serial>
Nov 13 20:41:40 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:41:40 user nova-compute[75239]:     <video>
Nov 13 20:41:40 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:41:40 user nova-compute[75239]:     </video>
Nov 13 20:41:40 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:41:40 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:41:40 user nova-compute[75239]:     </rng>
Nov 13 20:41:40 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:41:40 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:41:40 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:41:40 user nova-compute[75239]:     </memballoon>
Nov 13 20:41:40 user nova-compute[75239]:   </devices>
Nov 13 20:41:40 user nova-compute[75239]: </domain>
Nov 13 20:41:40 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1104629884',display_name='tempest-TestShelveInstance-server-1104629884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1104629884',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIKH+oCJ3NUeycdEu6o0ACiWfJa/kxXrNTIHezDCjZ4hZvwPmJKxpD3DthYAcv9iLh2oZ3SAgjtnpJ0CtwHOrOkHMhfLVc1u+0r3+jR3oH11gC8/uAbwmubEO5JCg7CFQ==',key_name='tempest-TestShelveInstance-438861881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4a480ab579c451799fbaac4af653379',ramdisk_id='',reservation_id='r-febrlktk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1910953819',owner_user_name='tempest-TestShelveInstance-1910953819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:41:34Z,user_data=None,user_id='41ee3d20cab9440d9564a3b536668fda',uuid=d6efe568-bf8d-4342-bb0e-0a878f7cccf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converting VIF {"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG os_vif [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bbf2f20-55cb-583f-aac5-4e9597c8e4e8', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b40e357-28, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b40e357-28, col_values=(('qos', UUID('129e27e0-c31b-42eb-8f71-63a3b8046b8a')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b40e357-28, col_values=(('external_ids', {'iface-id': '0b40e357-282b-4698-9af6-41acd4aa408b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:cb:d3', 'vm-uuid': 'd6efe568-bf8d-4342-bb0e-0a878f7cccf3'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:40 user nova-compute[75239]: INFO os_vif [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28')
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:41:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] No VIF found with MAC fa:16:3e:9d:cb:d3, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-21ccf4e1-711c-4803-abe2-cce0e92c5d10 req-2841e6d1-3cce-4313-85eb-aee4ce652d63 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21ccf4e1-711c-4803-abe2-cce0e92c5d10 req-2841e6d1-3cce-4313-85eb-aee4ce652d63 service nova] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21ccf4e1-711c-4803-abe2-cce0e92c5d10 req-2841e6d1-3cce-4313-85eb-aee4ce652d63 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21ccf4e1-711c-4803-abe2-cce0e92c5d10 req-2841e6d1-3cce-4313-85eb-aee4ce652d63 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-21ccf4e1-711c-4803-abe2-cce0e92c5d10 req-2841e6d1-3cce-4313-85eb-aee4ce652d63 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] No waiting events found dispatching network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:42 user nova-compute[75239]: WARNING nova.compute.manager [req-21ccf4e1-711c-4803-abe2-cce0e92c5d10 req-2841e6d1-3cce-4313-85eb-aee4ce652d63 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received unexpected event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b for instance with vm_state building and task_state spawning.
Nov 13 20:41:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:41:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Instance spawned successfully.
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-2104d93e-6268-4ad9-b66b-9b51ffe429a3 req-2d01da02-7545-4790-bd5c-e2cac5afefbf service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2104d93e-6268-4ad9-b66b-9b51ffe429a3 req-2d01da02-7545-4790-bd5c-e2cac5afefbf service nova] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2104d93e-6268-4ad9-b66b-9b51ffe429a3 req-2d01da02-7545-4790-bd5c-e2cac5afefbf service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2104d93e-6268-4ad9-b66b-9b51ffe429a3 req-2d01da02-7545-4790-bd5c-e2cac5afefbf service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-2104d93e-6268-4ad9-b66b-9b51ffe429a3 req-2d01da02-7545-4790-bd5c-e2cac5afefbf service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] No waiting events found dispatching network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:41:44 user nova-compute[75239]: WARNING nova.compute.manager [req-2104d93e-6268-4ad9-b66b-9b51ffe429a3 req-2d01da02-7545-4790-bd5c-e2cac5afefbf service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received unexpected event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b for instance with vm_state building and task_state spawning.
Nov 13 20:41:44 user nova-compute[75239]: INFO nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 13 20:41:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:41:44 user nova-compute[75239]: INFO nova.compute.manager [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Took 11.41 seconds to build instance.
Nov 13 20:41:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-36075c7f-ddcd-400d-98ec-86ebed97aaec tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.527s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:41:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:41:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:03 user nova-compute[75239]: INFO nova.compute.manager [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Terminating instance
Nov 13 20:42:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a1e99e3-07de-4bab-8eea-e2845f1480e6 req-0c0fd1ec-29b3-4877-978e-a88dff011ea8 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-unplugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a1e99e3-07de-4bab-8eea-e2845f1480e6 req-0c0fd1ec-29b3-4877-978e-a88dff011ea8 service nova] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a1e99e3-07de-4bab-8eea-e2845f1480e6 req-0c0fd1ec-29b3-4877-978e-a88dff011ea8 service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a1e99e3-07de-4bab-8eea-e2845f1480e6 req-0c0fd1ec-29b3-4877-978e-a88dff011ea8 service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a1e99e3-07de-4bab-8eea-e2845f1480e6 req-0c0fd1ec-29b3-4877-978e-a88dff011ea8 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] No waiting events found dispatching network-vif-unplugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a1e99e3-07de-4bab-8eea-e2845f1480e6 req-0c0fd1ec-29b3-4877-978e-a88dff011ea8 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-unplugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:03 user nova-compute[75239]: INFO nova.compute.manager [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Terminating instance
Nov 13 20:42:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Instance destroyed successfully.
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.objects.instance [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'resources' on Instance uuid 55f96b7f-454c-440a-9c78-f91305569e87 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2064952916',display_name='tempest-ServerActionsTestOtherA-server-1681381996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2064952916',id=15,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKe5xKWesSL7Xw6hcWc4RxdUahUkI+jkhDI4apiyCjXCfdLyQGOUt2pNUDacBxYeCp79YzytY/4Z4U7ALB2dqrqOE/L6p+WHD/S3QIse6iYs3wKwrVsyDyEByaRhcB+ag==',key_name='tempest-keypair-403991548',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:38:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-1gj70kp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=55f96b7f-454c-440a-9c78-f91305569e87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "address": "fa:16:3e:12:8f:22", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6563fee0-56", "ovs_interfaceid": "6563fee0-5628-49c4-b7f9-fb4799a36f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG os_vif [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6563fee0-56, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=005d7683-9ec2-481d-92f3-264c2faa8a91) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: INFO os_vif [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:8f:22,bridge_name='br-int',has_traffic_filtering=True,id=6563fee0-5628-49c4-b7f9-fb4799a36f70,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6563fee0-56')
Nov 13 20:42:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Deleting instance files /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87_del
Nov 13 20:42:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Deletion of /opt/stack/data/nova/instances/55f96b7f-454c-440a-9c78-f91305569e87_del complete
Nov 13 20:42:04 user nova-compute[75239]: INFO nova.compute.manager [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 13 20:42:04 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:42:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Instance destroyed successfully.
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.objects.instance [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'resources' on Instance uuid c3f6a68e-f57c-463f-81fd-e4e047421d5b {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-123715306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-123715306',id=13,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJycNLU0bhy2XhsxZOHqqC+x4cDsTf3LnWsRNHL6hFFjdVyVlQXzzyjCQn8YoXQ+dHwMmMoUvJN6eB/MQBaXgQ4735nV4x22OZ4jbmasf6gYcJu0Wwdvr27XrHBBoqb+OQ==',key_name='tempest-keypair-2045310531',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:39:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-26o52j6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:39:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=c3f6a68e-f57c-463f-81fd-e4e047421d5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "70460a6e-b85a-4875-94c8-fa1917a78871", "address": "fa:16:3e:1b:c8:80", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70460a6e-b8", "ovs_interfaceid": "70460a6e-b85a-4875-94c8-fa1917a78871", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG os_vif [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70460a6e-b8, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78e45787-1768-4a63-bd59-d2974b9da805) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:04 user nova-compute[75239]: INFO os_vif [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:c8:80,bridge_name='br-int',has_traffic_filtering=True,id=70460a6e-b85a-4875-94c8-fa1917a78871,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70460a6e-b8')
Nov 13 20:42:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Deleting instance files /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b_del
Nov 13 20:42:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Deletion of /opt/stack/data/nova/instances/c3f6a68e-f57c-463f-81fd-e4e047421d5b_del complete
Nov 13 20:42:04 user nova-compute[75239]: INFO nova.compute.manager [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 13 20:42:04 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:42:04 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] Acquiring lock "55f96b7f-454c-440a-9c78-f91305569e87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] Lock "55f96b7f-454c-440a-9c78-f91305569e87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] No waiting events found dispatching network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:42:05 user nova-compute[75239]: WARNING nova.compute.manager [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received unexpected event network-vif-plugged-6563fee0-5628-49c4-b7f9-fb4799a36f70 for instance with vm_state active and task_state deleting.
Nov 13 20:42:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-unplugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] No waiting events found dispatching network-vif-unplugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-unplugged-70460a6e-b85a-4875-94c8-fa1917a78871 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] Acquiring lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] No waiting events found dispatching network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:42:05 user nova-compute[75239]: WARNING nova.compute.manager [req-b5e9ffd8-f533-4f54-8d8e-3f509bb4ee9a req-69836be2-cb7d-4b17-96cd-7c8dc2095bbd service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received unexpected event network-vif-plugged-70460a6e-b85a-4875-94c8-fa1917a78871 for instance with vm_state active and task_state deleting.
Nov 13 20:42:05 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:42:05 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Took 1.54 seconds to deallocate network for instance.
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:06 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:42:06 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Took 1.48 seconds to deallocate network for instance.
Nov 13 20:42:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:06 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:42:06 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:42:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.466s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.124s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:06 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Deleted allocations for instance 55f96b7f-454c-440a-9c78-f91305569e87
Nov 13 20:42:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-32bf9b2f-df86-4f72-a1e7-bdbece96fa4f tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "55f96b7f-454c-440a-9c78-f91305569e87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.161s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:06 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:42:06 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:42:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:06 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Deleted allocations for instance c3f6a68e-f57c-463f-81fd-e4e047421d5b
Nov 13 20:42:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f78714fd-43a0-4adc-81cf-d405cf761051 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "c3f6a68e-f57c-463f-81fd-e4e047421d5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.135s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-b85ba452-16bb-4f64-a97b-3b47473a8498 req-edb9f44e-e0c8-4878-a0a7-56d9dfe8f117 service nova] [instance: 55f96b7f-454c-440a-9c78-f91305569e87] Received event network-vif-deleted-6563fee0-5628-49c4-b7f9-fb4799a36f70 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-b85ba452-16bb-4f64-a97b-3b47473a8498 req-edb9f44e-e0c8-4878-a0a7-56d9dfe8f117 service nova] [instance: c3f6a68e-f57c-463f-81fd-e4e047421d5b] Received event network-vif-deleted-70460a6e-b85a-4875-94c8-fa1917a78871 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-56e85dea-3b4f-4c65-8a12-781c9a115f6e req-d44e4db0-8fe1-4c87-8b45-306d3fbc5172 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received event network-changed-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-56e85dea-3b4f-4c65-8a12-781c9a115f6e req-d44e4db0-8fe1-4c87-8b45-306d3fbc5172 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Refreshing instance network info cache due to event network-changed-8f936d93-9923-4ea3-b6c6-a8ab85c07b29. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:42:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-56e85dea-3b4f-4c65-8a12-781c9a115f6e req-d44e4db0-8fe1-4c87-8b45-306d3fbc5172 service nova] Acquiring lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:42:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-56e85dea-3b4f-4c65-8a12-781c9a115f6e req-d44e4db0-8fe1-4c87-8b45-306d3fbc5172 service nova] Acquired lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:42:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-56e85dea-3b4f-4c65-8a12-781c9a115f6e req-d44e4db0-8fe1-4c87-8b45-306d3fbc5172 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Refreshing network info cache for port 8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:42:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-56e85dea-3b4f-4c65-8a12-781c9a115f6e req-d44e4db0-8fe1-4c87-8b45-306d3fbc5172 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Updated VIF entry in instance network info cache for port 8f936d93-9923-4ea3-b6c6-a8ab85c07b29. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:42:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-56e85dea-3b4f-4c65-8a12-781c9a115f6e req-d44e4db0-8fe1-4c87-8b45-306d3fbc5172 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Updating instance_info_cache with network_info: [{"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-56e85dea-3b4f-4c65-8a12-781c9a115f6e req-d44e4db0-8fe1-4c87-8b45-306d3fbc5172 service nova] Releasing lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG nova.objects.instance [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'flavor' on Instance uuid 0c4645d0-ba7a-4f2b-92fb-401891187489 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:14 user nova-compute[75239]: INFO nova.compute.manager [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Attaching volume bbbeca26-4a67-44a9-9a90-1ae85669967e to /dev/vdb
Nov 13 20:42:14 user nova-compute[75239]: DEBUG os_brick.utils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a6c298-99a8-4ae7-a638-86e1c7f214ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f38d386-a6c4-4a71-829e-b2cb9c081bd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22e9e6a-b381-4dfe-8a73-e9975f166c28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ca8574-30f9-41c0-b469-b3aed10bb791]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:42:14 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:42:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1a8705-7afc-47e6-85d0-1c716c476861]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG os_brick.utils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Updating existing volume attachment record: 82066b79-fa2c-4f43-9161-cd82b3b9a26c {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:42:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYVNBtyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:42:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:42:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:42:18 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb09901b-499a-4ca0-bbba-f1dd57993e3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:42:18 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf9a165-d1d2-4676-bf94-e511622779e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e] added
Nov 13 20:42:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[35479a44-797e-453c-88f8-9c957b9b193a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de5de2-237e-44a2-9989-63681d2587ec]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rYVNBtyD {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rYVNBtyD" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[240f364e-9355-49c7-870e-a5017542e640]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rYVNBtyD'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fc9fca-9839-48b3-a5c5-1ab0d072acc6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdf8bfb-02e0-48c5-9fc5-17a72b4ca253]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:42:18 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:42:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:42:18 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:42:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdfbb2a-e520-4c38-86ae-5f3400a9d7b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e, portal: 172.16.0.220,3260]
Nov 13 20:42:18 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e, portal: 172.16.0.220,3260] successful.
Nov 13 20:42:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[beda6a28-696f-47f6-8d89-07f6fbd1ced5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17149522-2cdb-4faf-8ebf-d80b98684a54]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:42:18 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:42:18 user nova-compute[75239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e (non-flash)
Nov 13 20:42:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:42:18 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:42:18 user nova-compute[75239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e (non-flash)
Nov 13 20:42:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa60589-9d6e-4221-9170-ce7ad9f3f181]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:42:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYVNBtyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:42:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:42:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23134393032646433', 'path': '/dev/sdd'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:42:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134393032646433', 'path': '/dev/sdd'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:42:19 user nova-compute[75239]: DEBUG nova.objects.instance [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'flavor' on Instance uuid 0c4645d0-ba7a-4f2b-92fb-401891187489 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:42:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:42:19 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:42:19 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:42:19 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:42:19 user nova-compute[75239]:   <serial>bbbeca26-4a67-44a9-9a90-1ae85669967e</serial>
Nov 13 20:42:19 user nova-compute[75239]: </disk>
Nov 13 20:42:19 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:42:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:42:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:42:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] No VIF found with MAC fa:16:3e:47:49:15, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:42:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ac72381c-d88c-4a3e-83f7-ad86faf5b702 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.533s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:21 user nova-compute[75239]: INFO nova.compute.manager [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Terminating instance
Nov 13 20:42:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:42:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-ad401ccc-a611-46d2-86d5-987114404a7c req-ff82e6b2-85b7-404e-bbe2-bcd9a732ea14 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ad401ccc-a611-46d2-86d5-987114404a7c req-ff82e6b2-85b7-404e-bbe2-bcd9a732ea14 service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ad401ccc-a611-46d2-86d5-987114404a7c req-ff82e6b2-85b7-404e-bbe2-bcd9a732ea14 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ad401ccc-a611-46d2-86d5-987114404a7c req-ff82e6b2-85b7-404e-bbe2-bcd9a732ea14 service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-ad401ccc-a611-46d2-86d5-987114404a7c req-ff82e6b2-85b7-404e-bbe2-bcd9a732ea14 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-ad401ccc-a611-46d2-86d5-987114404a7c req-ff82e6b2-85b7-404e-bbe2-bcd9a732ea14 service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-unplugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:42:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Instance destroyed successfully.
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'resources' on Instance uuid f59ce508-2487-4e71-8c09-ffd17dd0eafc {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1584967376',display_name='tempest-AttachVolumeTestJSON-server-1584967376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1584967376',id=2,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMKLqFZyQUrPE9Rky07V7+GOb/b3wRFXW0Dqh5CX+FEDomGoakG24id5wbLzS4TXRnaOkbwA4OVXWvMEC23O9oNn05+UEn3Pmq3JjLiMnSUlNw/+Sk65Td7hW84pUseSw==',key_name='tempest-keypair-823327680',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-9qfk4iec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=f59ce508-2487-4e71-8c09-ffd17dd0eafc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "address": "fa:16:3e:9f:11:19", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2c8770-f7", "ovs_interfaceid": "af2c8770-f7b4-4446-8061-7c377b8ad1f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG os_vif [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf2c8770-f7, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=660c0715-3481-48ec-b9a1-46570efd225c) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:22 user nova-compute[75239]: INFO os_vif [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:11:19,bridge_name='br-int',has_traffic_filtering=True,id=af2c8770-f7b4-4446-8061-7c377b8ad1f5,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2c8770-f7')
Nov 13 20:42:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Deleting instance files /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc_del
Nov 13 20:42:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Deletion of /opt/stack/data/nova/instances/f59ce508-2487-4e71-8c09-ffd17dd0eafc_del complete
Nov 13 20:42:22 user nova-compute[75239]: INFO nova.compute.manager [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 13 20:42:22 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:22 user nova-compute[75239]: INFO nova.compute.manager [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Detaching volume bbbeca26-4a67-44a9-9a90-1ae85669967e
Nov 13 20:42:22 user nova-compute[75239]: INFO nova.virt.block_device [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Attempting to driver detach volume bbbeca26-4a67-44a9-9a90-1ae85669967e from mountpoint /dev/vdb
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Attempting to detach device vdb from instance 0c4645d0-ba7a-4f2b-92fb-401891187489 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:42:22 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:42:22 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:42:22 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:42:22 user nova-compute[75239]:   <serial>bbbeca26-4a67-44a9-9a90-1ae85669967e</serial>
Nov 13 20:42:22 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:42:22 user nova-compute[75239]: </disk>
Nov 13 20:42:22 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:42:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Successfully detached device vdb from instance 0c4645d0-ba7a-4f2b-92fb-401891187489 from the persistent domain config.
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c4645d0-ba7a-4f2b-92fb-401891187489 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:42:22 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:42:22 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:42:22 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:42:22 user nova-compute[75239]:   <serial>bbbeca26-4a67-44a9-9a90-1ae85669967e</serial>
Nov 13 20:42:22 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:42:22 user nova-compute[75239]: </disk>
Nov 13 20:42:22 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:42:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c4645d0-ba7a-4f2b-92fb-401891187489 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:42:23 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:42:23 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Took 1.09 seconds to deallocate network for instance.
Nov 13 20:42:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-a05e9a25-03e9-4468-af86-17bca62095fd req-79a4329b-3ecc-4959-a436-9c970c37a9ef service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-deleted-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:23 user nova-compute[75239]: INFO nova.compute.manager [req-a05e9a25-03e9-4468-af86-17bca62095fd req-79a4329b-3ecc-4959-a436-9c970c37a9ef service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Neutron deleted interface af2c8770-f7b4-4446-8061-7c377b8ad1f5; detaching it from the instance and deleting it from the info cache
Nov 13 20:42:23 user nova-compute[75239]: DEBUG nova.network.neutron [req-a05e9a25-03e9-4468-af86-17bca62095fd req-79a4329b-3ecc-4959-a436-9c970c37a9ef service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:42:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-a05e9a25-03e9-4468-af86-17bca62095fd req-79a4329b-3ecc-4959-a436-9c970c37a9ef service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Detach interface failed, port_id=af2c8770-f7b4-4446-8061-7c377b8ad1f5, reason: Instance f59ce508-2487-4e71-8c09-ffd17dd0eafc could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:42:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:23 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:42:23 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:42:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:23 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Deleted allocations for instance f59ce508-2487-4e71-8c09-ffd17dd0eafc
Nov 13 20:42:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4e9330d9-cc8f-4e96-bf3d-f981db23b272 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.289s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-813f6c40-aace-4602-b483-d247989508b1 req-8bb0e5ed-5735-4520-af53-39b813265e8b service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-813f6c40-aace-4602-b483-d247989508b1 req-8bb0e5ed-5735-4520-af53-39b813265e8b service nova] Acquiring lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-813f6c40-aace-4602-b483-d247989508b1 req-8bb0e5ed-5735-4520-af53-39b813265e8b service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-813f6c40-aace-4602-b483-d247989508b1 req-8bb0e5ed-5735-4520-af53-39b813265e8b service nova] Lock "f59ce508-2487-4e71-8c09-ffd17dd0eafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-813f6c40-aace-4602-b483-d247989508b1 req-8bb0e5ed-5735-4520-af53-39b813265e8b service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] No waiting events found dispatching network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:42:24 user nova-compute[75239]: WARNING nova.compute.manager [req-813f6c40-aace-4602-b483-d247989508b1 req-8bb0e5ed-5735-4520-af53-39b813265e8b service nova] [instance: f59ce508-2487-4e71-8c09-ffd17dd0eafc] Received unexpected event network-vif-plugged-af2c8770-f7b4-4446-8061-7c377b8ad1f5 for instance with vm_state deleted and task_state None.
Nov 13 20:42:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:30 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:30 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:36 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:42:36 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7332MB free_disk=24.837871551513672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 0c4645d0-ba7a-4f2b-92fb-401891187489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d6efe568-bf8d-4342-bb0e-0a878f7cccf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:42:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:42:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:42:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:42:38 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:42:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updating instance_info_cache with network_info: [{"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:42:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:42:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:42:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:43 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0c4645d0-ba7a-4f2b-92fb-401891187489 is timed out.
Nov 13 20:42:43 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Successfully detached device vdb from instance 0c4645d0-ba7a-4f2b-92fb-401891187489 from the live domain config.
Nov 13 20:42:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rYVNBtyD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:42:43 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[803fbda8-29bb-4510-8c8d-1a76b0cce89f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:42:43 user nova-compute[75239]: No targets found.
Nov 13 20:42:43 user nova-compute[75239]: iSNS:
Nov 13 20:42:43 user nova-compute[75239]: No targets found.
Nov 13 20:42:43 user nova-compute[75239]: STATIC:
Nov 13 20:42:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:42:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:42:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:42:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e
Nov 13 20:42:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:42:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:42:43 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6
Nov 13 20:42:43 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:42:43 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:42:43 user nova-compute[75239]: FIRMWARE:
Nov 13 20:42:43 user nova-compute[75239]: No targets found.
Nov 13 20:42:43 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:42:43 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:42:43 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa335eb0-b81f-49a7-ba47-37ba41cc8adc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e29e48-3922-464e-94d5-db60d1725c9a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:42:43 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:42:43 user nova-compute[75239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e (non-flash)
Nov 13 20:42:43 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:42:43 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:42:43 user nova-compute[75239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e (non-flash)
Nov 13 20:42:43 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d846e9bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e'): ({'sdd'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Removing single pathed devices sdd {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e384e32-57a1-4b99-bd6d-12994864db75]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eeaae3-ea40-47c7-a360-165cf183b650]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Flushing IO for device /dev/sdd {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d44b27-0e7a-42f2-acf7-d015531af24b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82321760-c5f3-4b6e-ae4c-9efbbe510732]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a40e07-e4f8-4e4d-ae64-2c79543639be]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[981af7e6-64cc-44b3-88b7-34a6947cd5ae]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e, portal: 172.16.0.220,3260]
Nov 13 20:42:43 user nova-compute[75239]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e, portal: 172.16.0.220,3260] successful.
Nov 13 20:42:43 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbbeca26-4a67-44a9-9a90-1ae85669967e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aee54e-7b69-4d59-8629-19408b28fbdc]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] <== disconnect_volume: return (319ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:42:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:44 user nova-compute[75239]: DEBUG nova.objects.instance [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'flavor' on Instance uuid 0c4645d0-ba7a-4f2b-92fb-401891187489 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:42:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ace515e5-62fe-466b-a034-80631a0a6dce tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.693s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:42:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:42:48 user nova-compute[75239]: INFO nova.compute.claims [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Claim successful on node user
Nov 13 20:42:48 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:42:48 user nova-compute[75239]: DEBUG nova.network.neutron [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:42:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:42:49 user nova-compute[75239]: DEBUG nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG nova.policy [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd558e53105a840328eb2c0c5c2c36bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '259a798a23d94faf9e0267a4f13445da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:42:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Creating image(s)
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "/opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "/opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "/opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk 1073741824" returned: 0 in 0.069s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG nova.network.neutron [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Successfully created port: 3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Cannot resize image /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Ensure instance console log exists: /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.network.neutron [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Successfully updated port: 3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "refresh_cache-b24f2bf2-0c75-49c3-acce-c811f5454d8d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquired lock "refresh_cache-b24f2bf2-0c75-49c3-acce-c811f5454d8d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.network.neutron [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-ad5a5308-8d4c-47f7-bceb-5d0445a471e6 req-37d49f35-94c3-48cc-81fa-6ace9f7f4d89 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received event network-changed-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-ad5a5308-8d4c-47f7-bceb-5d0445a471e6 req-37d49f35-94c3-48cc-81fa-6ace9f7f4d89 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Refreshing instance network info cache due to event network-changed-3f327526-3f38-4901-b271-8e38739d7b59. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ad5a5308-8d4c-47f7-bceb-5d0445a471e6 req-37d49f35-94c3-48cc-81fa-6ace9f7f4d89 service nova] Acquiring lock "refresh_cache-b24f2bf2-0c75-49c3-acce-c811f5454d8d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.network.neutron [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.network.neutron [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Updating instance_info_cache with network_info: [{"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Releasing lock "refresh_cache-b24f2bf2-0c75-49c3-acce-c811f5454d8d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Instance network_info: |[{"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ad5a5308-8d4c-47f7-bceb-5d0445a471e6 req-37d49f35-94c3-48cc-81fa-6ace9f7f4d89 service nova] Acquired lock "refresh_cache-b24f2bf2-0c75-49c3-acce-c811f5454d8d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.network.neutron [req-ad5a5308-8d4c-47f7-bceb-5d0445a471e6 req-37d49f35-94c3-48cc-81fa-6ace9f7f4d89 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Refreshing network info cache for port 3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Start _get_guest_xml network_info=[{"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:42:50 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:42:50 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1198495123',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1198495123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1198495',id=27,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZXSuyqRFoitpB1QzlI11F4CQe/UWcG2SQfE0p9ct9EjiyE05jKD+MSEctJNmJh/kT+BbE4S5akntDWT2BNjSpG1DOnAwN20pzrfudPbYznUODBqZVMd+zwRxl5vI4X+A==',key_name='tempest-keypair-309249973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='259a798a23d94faf9e0267a4f13445da',ramdisk_id='',reservation_id='r-bk53s0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-956936833',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:42:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d558e53105a840328eb2c0c5c2c36bfa',uuid=b24f2bf2-0c75-49c3-acce-c811f5454d8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Converting VIF {"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:da:ce,bridge_name='br-int',has_traffic_filtering=True,id=3f327526-3f38-4901-b271-8e38739d7b59,network=Network(fba9f8a7-dc83-42c5-96c7-6f74323bf77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f327526-3f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.objects.instance [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lazy-loading 'pci_devices' on Instance uuid b24f2bf2-0c75-49c3-acce-c811f5454d8d {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:42:50 user nova-compute[75239]:   <uuid>b24f2bf2-0c75-49c3-acce-c811f5454d8d</uuid>
Nov 13 20:42:50 user nova-compute[75239]:   <name>instance-0000001b</name>
Nov 13 20:42:50 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:42:50 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:42:50 user nova-compute[75239]:   <metadata>
Nov 13 20:42:50 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:42:50 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:42:50 user nova-compute[75239]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1198495123</nova:name>
Nov 13 20:42:50 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:42:50</nova:creationTime>
Nov 13 20:42:50 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:42:50 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:42:50 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:42:50 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:42:50 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:42:50 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:42:50 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:42:50 user nova-compute[75239]:       <nova:owner>
Nov 13 20:42:50 user nova-compute[75239]:         <nova:user uuid="d558e53105a840328eb2c0c5c2c36bfa">tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member</nova:user>
Nov 13 20:42:50 user nova-compute[75239]:         <nova:project uuid="259a798a23d94faf9e0267a4f13445da">tempest-TestServerVolumeAttachScenarioOldVersion-956936833</nova:project>
Nov 13 20:42:50 user nova-compute[75239]:       </nova:owner>
Nov 13 20:42:50 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:42:50 user nova-compute[75239]:       <nova:ports>
Nov 13 20:42:50 user nova-compute[75239]:         <nova:port uuid="3f327526-3f38-4901-b271-8e38739d7b59">
Nov 13 20:42:50 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 20:42:50 user nova-compute[75239]:         </nova:port>
Nov 13 20:42:50 user nova-compute[75239]:       </nova:ports>
Nov 13 20:42:50 user nova-compute[75239]:     </nova:instance>
Nov 13 20:42:50 user nova-compute[75239]:   </metadata>
Nov 13 20:42:50 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:42:50 user nova-compute[75239]:     <system>
Nov 13 20:42:50 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:42:50 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:42:50 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:42:50 user nova-compute[75239]:       <entry name="serial">b24f2bf2-0c75-49c3-acce-c811f5454d8d</entry>
Nov 13 20:42:50 user nova-compute[75239]:       <entry name="uuid">b24f2bf2-0c75-49c3-acce-c811f5454d8d</entry>
Nov 13 20:42:50 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:42:50 user nova-compute[75239]:     </system>
Nov 13 20:42:50 user nova-compute[75239]:   </sysinfo>
Nov 13 20:42:50 user nova-compute[75239]:   <os>
Nov 13 20:42:50 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:42:50 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:42:50 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:42:50 user nova-compute[75239]:   </os>
Nov 13 20:42:50 user nova-compute[75239]:   <features>
Nov 13 20:42:50 user nova-compute[75239]:     <acpi/>
Nov 13 20:42:50 user nova-compute[75239]:     <apic/>
Nov 13 20:42:50 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:42:50 user nova-compute[75239]:   </features>
Nov 13 20:42:50 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:42:50 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:42:50 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:42:50 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:42:50 user nova-compute[75239]:   </clock>
Nov 13 20:42:50 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:42:50 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:42:50 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:42:50 user nova-compute[75239]:   </cpu>
Nov 13 20:42:50 user nova-compute[75239]:   <devices>
Nov 13 20:42:50 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:42:50 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:42:50 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk"/>
Nov 13 20:42:50 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:42:50 user nova-compute[75239]:     </disk>
Nov 13 20:42:50 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:42:50 user nova-compute[75239]:       <mac address="fa:16:3e:0b:da:ce"/>
Nov 13 20:42:50 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:42:50 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:42:50 user nova-compute[75239]:       <target dev="tap3f327526-3f"/>
Nov 13 20:42:50 user nova-compute[75239]:     </interface>
Nov 13 20:42:50 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:42:50 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/console.log" append="off"/>
Nov 13 20:42:50 user nova-compute[75239]:     </serial>
Nov 13 20:42:50 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:42:50 user nova-compute[75239]:     <video>
Nov 13 20:42:50 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:42:50 user nova-compute[75239]:     </video>
Nov 13 20:42:50 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:42:50 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:42:50 user nova-compute[75239]:     </rng>
Nov 13 20:42:50 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:42:50 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:42:50 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:42:50 user nova-compute[75239]:     </memballoon>
Nov 13 20:42:50 user nova-compute[75239]:   </devices>
Nov 13 20:42:50 user nova-compute[75239]: </domain>
Nov 13 20:42:50 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1198495123',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1198495123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1198495',id=27,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZXSuyqRFoitpB1QzlI11F4CQe/UWcG2SQfE0p9ct9EjiyE05jKD+MSEctJNmJh/kT+BbE4S5akntDWT2BNjSpG1DOnAwN20pzrfudPbYznUODBqZVMd+zwRxl5vI4X+A==',key_name='tempest-keypair-309249973',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='259a798a23d94faf9e0267a4f13445da',ramdisk_id='',reservation_id='r-bk53s0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-956936833',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:42:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d558e53105a840328eb2c0c5c2c36bfa',uuid=b24f2bf2-0c75-49c3-acce-c811f5454d8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Converting VIF {"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:da:ce,bridge_name='br-int',has_traffic_filtering=True,id=3f327526-3f38-4901-b271-8e38739d7b59,network=Network(fba9f8a7-dc83-42c5-96c7-6f74323bf77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f327526-3f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG os_vif [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:da:ce,bridge_name='br-int',has_traffic_filtering=True,id=3f327526-3f38-4901-b271-8e38739d7b59,network=Network(fba9f8a7-dc83-42c5-96c7-6f74323bf77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f327526-3f') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19e50cfd-9c56-5634-94be-46900df1d0c3', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f327526-3f, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f327526-3f, col_values=(('qos', UUID('38977415-48fa-419e-8caf-8e3138218326')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f327526-3f, col_values=(('external_ids', {'iface-id': '3f327526-3f38-4901-b271-8e38739d7b59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:da:ce', 'vm-uuid': 'b24f2bf2-0c75-49c3-acce-c811f5454d8d'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:50 user nova-compute[75239]: INFO os_vif [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:da:ce,bridge_name='br-int',has_traffic_filtering=True,id=3f327526-3f38-4901-b271-8e38739d7b59,network=Network(fba9f8a7-dc83-42c5-96c7-6f74323bf77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f327526-3f')
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:42:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] No VIF found with MAC fa:16:3e:0b:da:ce, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:42:51 user nova-compute[75239]: DEBUG nova.network.neutron [req-ad5a5308-8d4c-47f7-bceb-5d0445a471e6 req-37d49f35-94c3-48cc-81fa-6ace9f7f4d89 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Updated VIF entry in instance network info cache for port 3f327526-3f38-4901-b271-8e38739d7b59. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:42:51 user nova-compute[75239]: DEBUG nova.network.neutron [req-ad5a5308-8d4c-47f7-bceb-5d0445a471e6 req-37d49f35-94c3-48cc-81fa-6ace9f7f4d89 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Updating instance_info_cache with network_info: [{"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:42:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ad5a5308-8d4c-47f7-bceb-5d0445a471e6 req-37d49f35-94c3-48cc-81fa-6ace9f7f4d89 service nova] Releasing lock "refresh_cache-b24f2bf2-0c75-49c3-acce-c811f5454d8d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-8a36304d-1877-4f89-80e5-d556eb3dbd60 req-be8587d1-c4f2-4ec3-bf3c-d0ffa6d6c023 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received event network-vif-plugged-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8a36304d-1877-4f89-80e5-d556eb3dbd60 req-be8587d1-c4f2-4ec3-bf3c-d0ffa6d6c023 service nova] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8a36304d-1877-4f89-80e5-d556eb3dbd60 req-be8587d1-c4f2-4ec3-bf3c-d0ffa6d6c023 service nova] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8a36304d-1877-4f89-80e5-d556eb3dbd60 req-be8587d1-c4f2-4ec3-bf3c-d0ffa6d6c023 service nova] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-8a36304d-1877-4f89-80e5-d556eb3dbd60 req-be8587d1-c4f2-4ec3-bf3c-d0ffa6d6c023 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] No waiting events found dispatching network-vif-plugged-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:42:52 user nova-compute[75239]: WARNING nova.compute.manager [req-8a36304d-1877-4f89-80e5-d556eb3dbd60 req-be8587d1-c4f2-4ec3-bf3c-d0ffa6d6c023 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received unexpected event network-vif-plugged-3f327526-3f38-4901-b271-8e38739d7b59 for instance with vm_state building and task_state spawning.
Nov 13 20:42:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:42:54 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Instance spawned successfully.
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:42:54 user nova-compute[75239]: INFO nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-91ca3dbd-cf2f-495d-85c1-8f9b68a28416 req-d6365237-33ba-430a-ab7a-fd91ddaf8cbe service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received event network-vif-plugged-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-91ca3dbd-cf2f-495d-85c1-8f9b68a28416 req-d6365237-33ba-430a-ab7a-fd91ddaf8cbe service nova] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-91ca3dbd-cf2f-495d-85c1-8f9b68a28416 req-d6365237-33ba-430a-ab7a-fd91ddaf8cbe service nova] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-91ca3dbd-cf2f-495d-85c1-8f9b68a28416 req-d6365237-33ba-430a-ab7a-fd91ddaf8cbe service nova] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-91ca3dbd-cf2f-495d-85c1-8f9b68a28416 req-d6365237-33ba-430a-ab7a-fd91ddaf8cbe service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] No waiting events found dispatching network-vif-plugged-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:42:54 user nova-compute[75239]: WARNING nova.compute.manager [req-91ca3dbd-cf2f-495d-85c1-8f9b68a28416 req-d6365237-33ba-430a-ab7a-fd91ddaf8cbe service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received unexpected event network-vif-plugged-3f327526-3f38-4901-b271-8e38739d7b59 for instance with vm_state building and task_state spawning.
Nov 13 20:42:54 user nova-compute[75239]: INFO nova.compute.manager [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Took 6.10 seconds to build instance.
Nov 13 20:42:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89a9d940-9388-4059-870b-ae9cdee029c7 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.206s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:42:57 user nova-compute[75239]: INFO nova.compute.claims [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Claim successful on node user
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:42:57 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.policy [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21fc417bc25944ffb15dd30f9d7f0760', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d28d93b700143a988524063d92a102a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:42:57 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Creating image(s)
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk 1073741824" returned: 0 in 0.050s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Successfully created port: 0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.205s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Cannot resize image /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Ensure instance console log exists: /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:42:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Successfully updated port: 0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquired lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-a36f467e-3b6d-4465-8c4a-084c0eb00716 req-06e3b712-a53b-40e8-8df0-89187a4ec11b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-changed-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-a36f467e-3b6d-4465-8c4a-084c0eb00716 req-06e3b712-a53b-40e8-8df0-89187a4ec11b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Refreshing instance network info cache due to event network-changed-0be4f3e6-716b-4a52-b027-5a84d8415292. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a36f467e-3b6d-4465-8c4a-084c0eb00716 req-06e3b712-a53b-40e8-8df0-89187a4ec11b service nova] Acquiring lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating instance_info_cache with network_info: [{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Releasing lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance network_info: |[{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a36f467e-3b6d-4465-8c4a-084c0eb00716 req-06e3b712-a53b-40e8-8df0-89187a4ec11b service nova] Acquired lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-a36f467e-3b6d-4465-8c4a-084c0eb00716 req-06e3b712-a53b-40e8-8df0-89187a4ec11b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Refreshing network info cache for port 0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Start _get_guest_xml network_info=[{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:42:59 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:42:59 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1053010473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1053010473',id=28,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1MUOZJC1PwkWhvuRjvIe4l97M8X+mJObuO0KnCNwUZy+BooepOOUP+DTeLCizOjuaf8v86GPelp+OBYk6AdkhvEu/Ve/cqycjHiSR/O3kYCZ3UNQiwFXuMbBvSW/oGWQ==',key_name='tempest-keypair-452032804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-fffww73p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=7525c321-c164-4d14-8364-23f07eb826b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'pci_devices' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:42:59 user nova-compute[75239]:   <uuid>7525c321-c164-4d14-8364-23f07eb826b6</uuid>
Nov 13 20:42:59 user nova-compute[75239]:   <name>instance-0000001c</name>
Nov 13 20:42:59 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:42:59 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:42:59 user nova-compute[75239]:   <metadata>
Nov 13 20:42:59 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:42:59 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:42:59 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1053010473</nova:name>
Nov 13 20:42:59 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:42:59</nova:creationTime>
Nov 13 20:42:59 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:42:59 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:42:59 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:42:59 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:42:59 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:42:59 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:42:59 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:42:59 user nova-compute[75239]:       <nova:owner>
Nov 13 20:42:59 user nova-compute[75239]:         <nova:user uuid="21fc417bc25944ffb15dd30f9d7f0760">tempest-AttachVolumeShelveTestJSON-2022096331-project-member</nova:user>
Nov 13 20:42:59 user nova-compute[75239]:         <nova:project uuid="2d28d93b700143a988524063d92a102a">tempest-AttachVolumeShelveTestJSON-2022096331</nova:project>
Nov 13 20:42:59 user nova-compute[75239]:       </nova:owner>
Nov 13 20:42:59 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:42:59 user nova-compute[75239]:       <nova:ports>
Nov 13 20:42:59 user nova-compute[75239]:         <nova:port uuid="0be4f3e6-716b-4a52-b027-5a84d8415292">
Nov 13 20:42:59 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 20:42:59 user nova-compute[75239]:         </nova:port>
Nov 13 20:42:59 user nova-compute[75239]:       </nova:ports>
Nov 13 20:42:59 user nova-compute[75239]:     </nova:instance>
Nov 13 20:42:59 user nova-compute[75239]:   </metadata>
Nov 13 20:42:59 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:42:59 user nova-compute[75239]:     <system>
Nov 13 20:42:59 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:42:59 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:42:59 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:42:59 user nova-compute[75239]:       <entry name="serial">7525c321-c164-4d14-8364-23f07eb826b6</entry>
Nov 13 20:42:59 user nova-compute[75239]:       <entry name="uuid">7525c321-c164-4d14-8364-23f07eb826b6</entry>
Nov 13 20:42:59 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:42:59 user nova-compute[75239]:     </system>
Nov 13 20:42:59 user nova-compute[75239]:   </sysinfo>
Nov 13 20:42:59 user nova-compute[75239]:   <os>
Nov 13 20:42:59 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:42:59 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:42:59 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:42:59 user nova-compute[75239]:   </os>
Nov 13 20:42:59 user nova-compute[75239]:   <features>
Nov 13 20:42:59 user nova-compute[75239]:     <acpi/>
Nov 13 20:42:59 user nova-compute[75239]:     <apic/>
Nov 13 20:42:59 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:42:59 user nova-compute[75239]:   </features>
Nov 13 20:42:59 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:42:59 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:42:59 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:42:59 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:42:59 user nova-compute[75239]:   </clock>
Nov 13 20:42:59 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:42:59 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:42:59 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:42:59 user nova-compute[75239]:   </cpu>
Nov 13 20:42:59 user nova-compute[75239]:   <devices>
Nov 13 20:42:59 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:42:59 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:42:59 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk"/>
Nov 13 20:42:59 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:42:59 user nova-compute[75239]:     </disk>
Nov 13 20:42:59 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:42:59 user nova-compute[75239]:       <mac address="fa:16:3e:24:10:3f"/>
Nov 13 20:42:59 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:42:59 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:42:59 user nova-compute[75239]:       <target dev="tap0be4f3e6-71"/>
Nov 13 20:42:59 user nova-compute[75239]:     </interface>
Nov 13 20:42:59 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:42:59 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/console.log" append="off"/>
Nov 13 20:42:59 user nova-compute[75239]:     </serial>
Nov 13 20:42:59 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:42:59 user nova-compute[75239]:     <video>
Nov 13 20:42:59 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:42:59 user nova-compute[75239]:     </video>
Nov 13 20:42:59 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:42:59 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:42:59 user nova-compute[75239]:     </rng>
Nov 13 20:42:59 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:42:59 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:42:59 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:42:59 user nova-compute[75239]:     </memballoon>
Nov 13 20:42:59 user nova-compute[75239]:   </devices>
Nov 13 20:42:59 user nova-compute[75239]: </domain>
Nov 13 20:42:59 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1053010473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1053010473',id=28,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1MUOZJC1PwkWhvuRjvIe4l97M8X+mJObuO0KnCNwUZy+BooepOOUP+DTeLCizOjuaf8v86GPelp+OBYk6AdkhvEu/Ve/cqycjHiSR/O3kYCZ3UNQiwFXuMbBvSW/oGWQ==',key_name='tempest-keypair-452032804',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-fffww73p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=7525c321-c164-4d14-8364-23f07eb826b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG os_vif [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8e8f295-99ce-5717-a1a6-cf1f0a931710', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0be4f3e6-71, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0be4f3e6-71, col_values=(('qos', UUID('7cca2e12-6553-44c5-b7de-23c3fff6a5f7')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0be4f3e6-71, col_values=(('external_ids', {'iface-id': '0be4f3e6-716b-4a52-b027-5a84d8415292', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:10:3f', 'vm-uuid': '7525c321-c164-4d14-8364-23f07eb826b6'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:42:59 user nova-compute[75239]: INFO os_vif [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71')
Nov 13 20:42:59 user nova-compute[75239]: INFO nova.compute.manager [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] instance snapshotting
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:42:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] No VIF found with MAC fa:16:3e:24:10:3f, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:42:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Beginning live snapshot process
Nov 13 20:43:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json -f qcow2 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG nova.network.neutron [req-a36f467e-3b6d-4465-8c4a-084c0eb00716 req-06e3b712-a53b-40e8-8df0-89187a4ec11b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updated VIF entry in instance network info cache for port 0be4f3e6-716b-4a52-b027-5a84d8415292. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG nova.network.neutron [req-a36f467e-3b6d-4465-8c4a-084c0eb00716 req-06e3b712-a53b-40e8-8df0-89187a4ec11b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating instance_info_cache with network_info: [{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a36f467e-3b6d-4465-8c4a-084c0eb00716 req-06e3b712-a53b-40e8-8df0-89187a4ec11b service nova] Releasing lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json -f qcow2" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json -f qcow2 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.234s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4q33c09s/4a634b46456044959683d510445c83bd.delta 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4q33c09s/4a634b46456044959683d510445c83bd.delta 1073741824" returned: 0 in 0.055s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:00 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 20:43:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] COPY block job progress, current cursor: 131072 final cursor: 75497472 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:43:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 20:43:02 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 20:43:02 user nova-compute[75239]: DEBUG nova.compute.manager [req-5c54602d-7da2-4d01-ba7e-b0696c64f262 req-1316e46a-5daa-45b7-9ed7-ccc58773e406 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5c54602d-7da2-4d01-ba7e-b0696c64f262 req-1316e46a-5daa-45b7-9ed7-ccc58773e406 service nova] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5c54602d-7da2-4d01-ba7e-b0696c64f262 req-1316e46a-5daa-45b7-9ed7-ccc58773e406 service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5c54602d-7da2-4d01-ba7e-b0696c64f262 req-1316e46a-5daa-45b7-9ed7-ccc58773e406 service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG nova.compute.manager [req-5c54602d-7da2-4d01-ba7e-b0696c64f262 req-1316e46a-5daa-45b7-9ed7-ccc58773e406 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] No waiting events found dispatching network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:02 user nova-compute[75239]: WARNING nova.compute.manager [req-5c54602d-7da2-4d01-ba7e-b0696c64f262 req-1316e46a-5daa-45b7-9ed7-ccc58773e406 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received unexpected event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 for instance with vm_state building and task_state spawning.
Nov 13 20:43:02 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4q33c09s/4a634b46456044959683d510445c83bd.delta /opt/stack/data/nova/instances/snapshots/tmp4q33c09s/4a634b46456044959683d510445c83bd {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4q33c09s/4a634b46456044959683d510445c83bd.delta /opt/stack/data/nova/instances/snapshots/tmp4q33c09s/4a634b46456044959683d510445c83bd" returned: 0 in 0.591s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:02 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Snapshot extracted, beginning image upload
Nov 13 20:43:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:43:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance spawned successfully.
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-d83671e9-7509-49be-b135-061ba223bbb3 req-9e537ebc-dbaa-4817-8f37-334cc921b973 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d83671e9-7509-49be-b135-061ba223bbb3 req-9e537ebc-dbaa-4817-8f37-334cc921b973 service nova] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d83671e9-7509-49be-b135-061ba223bbb3 req-9e537ebc-dbaa-4817-8f37-334cc921b973 service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d83671e9-7509-49be-b135-061ba223bbb3 req-9e537ebc-dbaa-4817-8f37-334cc921b973 service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-d83671e9-7509-49be-b135-061ba223bbb3 req-9e537ebc-dbaa-4817-8f37-334cc921b973 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] No waiting events found dispatching network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:04 user nova-compute[75239]: WARNING nova.compute.manager [req-d83671e9-7509-49be-b135-061ba223bbb3 req-9e537ebc-dbaa-4817-8f37-334cc921b973 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received unexpected event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 for instance with vm_state building and task_state spawning.
Nov 13 20:43:04 user nova-compute[75239]: INFO nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 13 20:43:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:43:04 user nova-compute[75239]: INFO nova.compute.manager [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Took 7.23 seconds to build instance.
Nov 13 20:43:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d49b0928-8426-4d72-84e5-0c10c6b64781 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.344s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:05 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Snapshot image upload complete
Nov 13 20:43:05 user nova-compute[75239]: INFO nova.compute.manager [None req-ac4a3b63-161d-40b7-b405-ea01dabb2c38 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Took 5.61 seconds to snapshot the instance on the hypervisor.
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG nova.objects.instance [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'flavor' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:06 user nova-compute[75239]: INFO nova.compute.manager [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Attaching volume 07264292-6803-485b-b4cf-8972a13855ca to /dev/vdb
Nov 13 20:43:06 user nova-compute[75239]: DEBUG os_brick.utils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a805a-ff98-4e50-8891-0db7d0fab9e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a99c5a2-9ef0-4a08-b732-792e62d0b868]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bfb2b7-1a17-4b45-9c07-83f742e03847]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f5c2b-e9ce-4a52-8377-7bd60050e3d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:43:06 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:43:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[502bd661-e122-470e-96fe-d62381ff9225]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG os_brick.utils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:06 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating existing volume attachment record: c879671b-d39b-4cb0-8f29-15837baa3806 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:43:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZPtAaiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:10 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:10 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:10 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde5b0c5-67c8-4067-bf77-dd6bea930bbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:43:10 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a59569-9b00-4772-ba8b-ae65f38ea939]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca] added
Nov 13 20:43:10 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6395af1f-e046-4251-a134-12e59754858c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4022741e-617f-4c16-ac39-a0cebc3329d7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:10 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZPtAaiF {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZPtAaiF" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8627c13c-626a-4d28-bf85-474dc7cb4c6d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gZPtAaiF'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3b9098-3dc4-4e64-a39b-111c15620773]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4232ca-b6db-49a0-9098-a1a818da5f0d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:11 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:11 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a52e2d0-5ff1-4411-ab78-d1f1717d74d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260]
Nov 13 20:43:11 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260] successful.
Nov 13 20:43:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc929e4-cb4e-46c7-a085-0a7bfb63d624]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9615f918-09d1-443b-a15e-84fa4a5e777f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:11 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:11 user nova-compute[75239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:11 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:11 user nova-compute[75239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34202403-c33e-4b50-8b50-a9586de4e714]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:43:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZPtAaiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23032353662636163', 'path': '/dev/sdd'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032353662636163', 'path': '/dev/sdd'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG nova.objects.instance [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'flavor' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:43:12 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:43:12 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:43:12 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:43:12 user nova-compute[75239]:   <serial>07264292-6803-485b-b4cf-8972a13855ca</serial>
Nov 13 20:43:12 user nova-compute[75239]: </disk>
Nov 13 20:43:12 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No VIF found with MAC fa:16:3e:b3:7c:48, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-833e1d6c-4b7b-4800-8f31-a03132bca087 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.303s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-2774821e-de80-4a0c-9999-d12d006c0a5c req-4e8aa0c5-0a82-48d9-986f-ebf2909ab6ca service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received event network-changed-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-2774821e-de80-4a0c-9999-d12d006c0a5c req-4e8aa0c5-0a82-48d9-986f-ebf2909ab6ca service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Refreshing instance network info cache due to event network-changed-8f936d93-9923-4ea3-b6c6-a8ab85c07b29. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2774821e-de80-4a0c-9999-d12d006c0a5c req-4e8aa0c5-0a82-48d9-986f-ebf2909ab6ca service nova] Acquiring lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2774821e-de80-4a0c-9999-d12d006c0a5c req-4e8aa0c5-0a82-48d9-986f-ebf2909ab6ca service nova] Acquired lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-2774821e-de80-4a0c-9999-d12d006c0a5c req-4e8aa0c5-0a82-48d9-986f-ebf2909ab6ca service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Refreshing network info cache for port 8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:43:13 user nova-compute[75239]: INFO nova.compute.manager [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Terminating instance
Nov 13 20:43:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-4285551a-8296-44d7-8eeb-ea04b1a06dc8 req-c3fac47c-16c4-4295-93e2-ef41d93b2673 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received event network-vif-unplugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4285551a-8296-44d7-8eeb-ea04b1a06dc8 req-c3fac47c-16c4-4295-93e2-ef41d93b2673 service nova] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4285551a-8296-44d7-8eeb-ea04b1a06dc8 req-c3fac47c-16c4-4295-93e2-ef41d93b2673 service nova] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4285551a-8296-44d7-8eeb-ea04b1a06dc8 req-c3fac47c-16c4-4295-93e2-ef41d93b2673 service nova] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-4285551a-8296-44d7-8eeb-ea04b1a06dc8 req-c3fac47c-16c4-4295-93e2-ef41d93b2673 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] No waiting events found dispatching network-vif-unplugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-4285551a-8296-44d7-8eeb-ea04b1a06dc8 req-c3fac47c-16c4-4295-93e2-ef41d93b2673 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received event network-vif-unplugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-2774821e-de80-4a0c-9999-d12d006c0a5c req-4e8aa0c5-0a82-48d9-986f-ebf2909ab6ca service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Updated VIF entry in instance network info cache for port 8f936d93-9923-4ea3-b6c6-a8ab85c07b29. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-2774821e-de80-4a0c-9999-d12d006c0a5c req-4e8aa0c5-0a82-48d9-986f-ebf2909ab6ca service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Updating instance_info_cache with network_info: [{"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2774821e-de80-4a0c-9999-d12d006c0a5c req-4e8aa0c5-0a82-48d9-986f-ebf2909ab6ca service nova] Releasing lock "refresh_cache-0c4645d0-ba7a-4f2b-92fb-401891187489" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:14 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Instance destroyed successfully.
Nov 13 20:43:14 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'resources' on Instance uuid 0c4645d0-ba7a-4f2b-92fb-401891187489 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:40:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-939999172',display_name='tempest-TestStampPattern-server-939999172',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-939999172',id=23,image_ref='1272dd96-03a4-4f1d-8638-2baf2982e57b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsJkUh8tzjbwjGz2z/FPh6VoEoc5eNHl/mHpg0AYJPwTCL8t4LK5SGwpvdKX8mICr9zRERa/UEuI0kQJy2b6EW0qfB+fmIFb5tJy6989x+nGNRdNksl6VWF1E+4Wj6iBQ==',key_name='tempest-TestStampPattern-1567089186',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:40:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d292feb205994cddb6f2765da53fee90',ramdisk_id='',reservation_id='r-gsqlj83x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1ec27628-db61-49c0-951b-6e72ac2f4f15',image_min_disk='1',image_min_ram='0',image_owner_id='d292feb205994cddb6f2765da53fee90',image_owner_project_name='tempest-TestStampPattern-1429319310',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1429319310-project-member',image_user_id='297728d5d4c4454a9f9acd594d24b232',owner_project_name='tempest-TestStampPattern-1429319310',owner_user_name='tempest-TestStampPattern-1429319310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:40:29Z,user_data=None,user_id='297728d5d4c4454a9f9acd594d24b232',uuid=0c4645d0-ba7a-4f2b-92fb-401891187489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converting VIF {"id": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "address": "fa:16:3e:47:49:15", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f936d93-99", "ovs_interfaceid": "8f936d93-9923-4ea3-b6c6-a8ab85c07b29", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:49:15,bridge_name='br-int',has_traffic_filtering=True,id=8f936d93-9923-4ea3-b6c6-a8ab85c07b29,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f936d93-99') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG os_vif [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:49:15,bridge_name='br-int',has_traffic_filtering=True,id=8f936d93-9923-4ea3-b6c6-a8ab85c07b29,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f936d93-99') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f936d93-99, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb7f842c-902d-4b81-889e-654879c7a3aa) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:14 user nova-compute[75239]: INFO os_vif [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:49:15,bridge_name='br-int',has_traffic_filtering=True,id=8f936d93-9923-4ea3-b6c6-a8ab85c07b29,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f936d93-99')
Nov 13 20:43:14 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Deleting instance files /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489_del
Nov 13 20:43:14 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Deletion of /opt/stack/data/nova/instances/0c4645d0-ba7a-4f2b-92fb-401891187489_del complete
Nov 13 20:43:14 user nova-compute[75239]: INFO nova.compute.manager [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 20:43:14 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:14 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Took 0.59 seconds to deallocate network for instance.
Nov 13 20:43:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.585s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:15 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Deleted allocations for instance 0c4645d0-ba7a-4f2b-92fb-401891187489
Nov 13 20:43:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7d8d8e84-7d5c-43e2-bcc2-906332a091d9 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.279s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:43:15 user nova-compute[75239]: INFO nova.compute.claims [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Claim successful on node user
Nov 13 20:43:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-9d72a09a-be51-4629-b9fb-d68a2f0024cd req-454958ad-a859-4c60-8088-2bad31cb4941 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received event network-vif-plugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9d72a09a-be51-4629-b9fb-d68a2f0024cd req-454958ad-a859-4c60-8088-2bad31cb4941 service nova] Acquiring lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9d72a09a-be51-4629-b9fb-d68a2f0024cd req-454958ad-a859-4c60-8088-2bad31cb4941 service nova] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9d72a09a-be51-4629-b9fb-d68a2f0024cd req-454958ad-a859-4c60-8088-2bad31cb4941 service nova] Lock "0c4645d0-ba7a-4f2b-92fb-401891187489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-9d72a09a-be51-4629-b9fb-d68a2f0024cd req-454958ad-a859-4c60-8088-2bad31cb4941 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] No waiting events found dispatching network-vif-plugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:15 user nova-compute[75239]: WARNING nova.compute.manager [req-9d72a09a-be51-4629-b9fb-d68a2f0024cd req-454958ad-a859-4c60-8088-2bad31cb4941 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received unexpected event network-vif-plugged-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 for instance with vm_state deleted and task_state None.
Nov 13 20:43:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-9d72a09a-be51-4629-b9fb-d68a2f0024cd req-454958ad-a859-4c60-8088-2bad31cb4941 service nova] [instance: 0c4645d0-ba7a-4f2b-92fb-401891187489] Received event network-vif-deleted-8f936d93-9923-4ea3-b6c6-a8ab85c07b29 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-77367d82-3555-4b70-bcb5-214004ad6dd2 req-3fbdcc4d-f14a-4189-ae2c-0648a3445d2a service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-77367d82-3555-4b70-bcb5-214004ad6dd2 req-3fbdcc4d-f14a-4189-ae2c-0648a3445d2a service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing instance network info cache due to event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-77367d82-3555-4b70-bcb5-214004ad6dd2 req-3fbdcc4d-f14a-4189-ae2c-0648a3445d2a service nova] Acquiring lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-77367d82-3555-4b70-bcb5-214004ad6dd2 req-3fbdcc4d-f14a-4189-ae2c-0648a3445d2a service nova] Acquired lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.network.neutron [req-77367d82-3555-4b70-bcb5-214004ad6dd2 req-3fbdcc4d-f14a-4189-ae2c-0648a3445d2a service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:43:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:43:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Creating image(s)
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "/opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "/opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "/opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.policy [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1fa0bf5a26e4844a22d48ce70d8dc0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0a86eedbea84af3a57a6a4b266c06d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.network.neutron [req-77367d82-3555-4b70-bcb5-214004ad6dd2 req-3fbdcc4d-f14a-4189-ae2c-0648a3445d2a service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updated VIF entry in instance network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG nova.network.neutron [req-77367d82-3555-4b70-bcb5-214004ad6dd2 req-3fbdcc4d-f14a-4189-ae2c-0648a3445d2a service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating instance_info_cache with network_info: [{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-77367d82-3555-4b70-bcb5-214004ad6dd2 req-3fbdcc4d-f14a-4189-ae2c-0648a3445d2a service nova] Releasing lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk 1073741824" returned: 0 in 0.065s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Successfully created port: dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Cannot resize image /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Ensure instance console log exists: /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:17 user nova-compute[75239]: INFO nova.compute.manager [None req-b6c812d8-c02a-4a97-8ef9-66b17a13cc32 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Unrescuing
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b6c812d8-c02a-4a97-8ef9-66b17a13cc32 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b6c812d8-c02a-4a97-8ef9-66b17a13cc32 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquired lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b6c812d8-c02a-4a97-8ef9-66b17a13cc32 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Successfully updated port: dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "refresh_cache-40d7bf6c-7117-431d-9223-8b7068f58d4e" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquired lock "refresh_cache-40d7bf6c-7117-431d-9223-8b7068f58d4e" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-3caf71ab-1173-4ddd-9f37-1ed73697c28b req-2b95b8b5-702a-473c-b780-86c84857bde7 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-changed-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-3caf71ab-1173-4ddd-9f37-1ed73697c28b req-2b95b8b5-702a-473c-b780-86c84857bde7 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Refreshing instance network info cache due to event network-changed-dae63bc6-ac2b-45d5-a433-c8135bac7740. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:43:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3caf71ab-1173-4ddd-9f37-1ed73697c28b req-2b95b8b5-702a-473c-b780-86c84857bde7 service nova] Acquiring lock "refresh_cache-40d7bf6c-7117-431d-9223-8b7068f58d4e" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-5badd69e-5137-460f-8d9f-2a3f3b9ffa7f req-00ccfc11-eea1-4e84-8b36-b4ceada5fdf0 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-5badd69e-5137-460f-8d9f-2a3f3b9ffa7f req-00ccfc11-eea1-4e84-8b36-b4ceada5fdf0 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing instance network info cache due to event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5badd69e-5137-460f-8d9f-2a3f3b9ffa7f req-00ccfc11-eea1-4e84-8b36-b4ceada5fdf0 service nova] Acquiring lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5badd69e-5137-460f-8d9f-2a3f3b9ffa7f req-00ccfc11-eea1-4e84-8b36-b4ceada5fdf0 service nova] Acquired lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.network.neutron [req-5badd69e-5137-460f-8d9f-2a3f3b9ffa7f req-00ccfc11-eea1-4e84-8b36-b4ceada5fdf0 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Updating instance_info_cache with network_info: [{"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Releasing lock "refresh_cache-40d7bf6c-7117-431d-9223-8b7068f58d4e" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Instance network_info: |[{"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3caf71ab-1173-4ddd-9f37-1ed73697c28b req-2b95b8b5-702a-473c-b780-86c84857bde7 service nova] Acquired lock "refresh_cache-40d7bf6c-7117-431d-9223-8b7068f58d4e" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.network.neutron [req-3caf71ab-1173-4ddd-9f37-1ed73697c28b req-2b95b8b5-702a-473c-b780-86c84857bde7 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Refreshing network info cache for port dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Start _get_guest_xml network_info=[{"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:43:18 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:43:18 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-671376649',display_name='tempest-AttachVolumeTestJSON-server-671376649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-671376649',id=29,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbYphv0kCriXhVyiAjlkXG1lXrfEo2VkfVBaiK5vz0ZPP11gVz79i5tE7J2jhhf4JxSF4KgwRtTNf7DdKbpDqvkTy/ht9Hg0FYyi3m5FagA2dTyInteWFKsMPQm5yYslg==',key_name='tempest-keypair-2079922746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-nke46j0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=40d7bf6c-7117-431d-9223-8b7068f58d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d6:c8,bridge_name='br-int',has_traffic_filtering=True,id=dae63bc6-ac2b-45d5-a433-c8135bac7740,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae63bc6-ac') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.objects.instance [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'pci_devices' on Instance uuid 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:43:18 user nova-compute[75239]:   <uuid>40d7bf6c-7117-431d-9223-8b7068f58d4e</uuid>
Nov 13 20:43:18 user nova-compute[75239]:   <name>instance-0000001d</name>
Nov 13 20:43:18 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:43:18 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:43:18 user nova-compute[75239]:   <metadata>
Nov 13 20:43:18 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:43:18 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:43:18 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeTestJSON-server-671376649</nova:name>
Nov 13 20:43:18 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:43:18</nova:creationTime>
Nov 13 20:43:18 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:43:18 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:43:18 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:43:18 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:43:18 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:43:18 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:43:18 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:43:18 user nova-compute[75239]:       <nova:owner>
Nov 13 20:43:18 user nova-compute[75239]:         <nova:user uuid="a1fa0bf5a26e4844a22d48ce70d8dc0a">tempest-AttachVolumeTestJSON-2111443236-project-member</nova:user>
Nov 13 20:43:18 user nova-compute[75239]:         <nova:project uuid="b0a86eedbea84af3a57a6a4b266c06d4">tempest-AttachVolumeTestJSON-2111443236</nova:project>
Nov 13 20:43:18 user nova-compute[75239]:       </nova:owner>
Nov 13 20:43:18 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:43:18 user nova-compute[75239]:       <nova:ports>
Nov 13 20:43:18 user nova-compute[75239]:         <nova:port uuid="dae63bc6-ac2b-45d5-a433-c8135bac7740">
Nov 13 20:43:18 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 20:43:18 user nova-compute[75239]:         </nova:port>
Nov 13 20:43:18 user nova-compute[75239]:       </nova:ports>
Nov 13 20:43:18 user nova-compute[75239]:     </nova:instance>
Nov 13 20:43:18 user nova-compute[75239]:   </metadata>
Nov 13 20:43:18 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:43:18 user nova-compute[75239]:     <system>
Nov 13 20:43:18 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:43:18 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:43:18 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:43:18 user nova-compute[75239]:       <entry name="serial">40d7bf6c-7117-431d-9223-8b7068f58d4e</entry>
Nov 13 20:43:18 user nova-compute[75239]:       <entry name="uuid">40d7bf6c-7117-431d-9223-8b7068f58d4e</entry>
Nov 13 20:43:18 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:43:18 user nova-compute[75239]:     </system>
Nov 13 20:43:18 user nova-compute[75239]:   </sysinfo>
Nov 13 20:43:18 user nova-compute[75239]:   <os>
Nov 13 20:43:18 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:43:18 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:43:18 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:43:18 user nova-compute[75239]:   </os>
Nov 13 20:43:18 user nova-compute[75239]:   <features>
Nov 13 20:43:18 user nova-compute[75239]:     <acpi/>
Nov 13 20:43:18 user nova-compute[75239]:     <apic/>
Nov 13 20:43:18 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:43:18 user nova-compute[75239]:   </features>
Nov 13 20:43:18 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:43:18 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:43:18 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:43:18 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:43:18 user nova-compute[75239]:   </clock>
Nov 13 20:43:18 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:43:18 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:43:18 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:43:18 user nova-compute[75239]:   </cpu>
Nov 13 20:43:18 user nova-compute[75239]:   <devices>
Nov 13 20:43:18 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:43:18 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:43:18 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk"/>
Nov 13 20:43:18 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:43:18 user nova-compute[75239]:     </disk>
Nov 13 20:43:18 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:43:18 user nova-compute[75239]:       <mac address="fa:16:3e:07:d6:c8"/>
Nov 13 20:43:18 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:43:18 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:43:18 user nova-compute[75239]:       <target dev="tapdae63bc6-ac"/>
Nov 13 20:43:18 user nova-compute[75239]:     </interface>
Nov 13 20:43:18 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:43:18 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/console.log" append="off"/>
Nov 13 20:43:18 user nova-compute[75239]:     </serial>
Nov 13 20:43:18 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:43:18 user nova-compute[75239]:     <video>
Nov 13 20:43:18 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:43:18 user nova-compute[75239]:     </video>
Nov 13 20:43:18 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:43:18 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:43:18 user nova-compute[75239]:     </rng>
Nov 13 20:43:18 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:43:18 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:43:18 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:43:18 user nova-compute[75239]:     </memballoon>
Nov 13 20:43:18 user nova-compute[75239]:   </devices>
Nov 13 20:43:18 user nova-compute[75239]: </domain>
Nov 13 20:43:18 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-671376649',display_name='tempest-AttachVolumeTestJSON-server-671376649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-671376649',id=29,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbYphv0kCriXhVyiAjlkXG1lXrfEo2VkfVBaiK5vz0ZPP11gVz79i5tE7J2jhhf4JxSF4KgwRtTNf7DdKbpDqvkTy/ht9Hg0FYyi3m5FagA2dTyInteWFKsMPQm5yYslg==',key_name='tempest-keypair-2079922746',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-nke46j0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:43:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=40d7bf6c-7117-431d-9223-8b7068f58d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:d6:c8,bridge_name='br-int',has_traffic_filtering=True,id=dae63bc6-ac2b-45d5-a433-c8135bac7740,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae63bc6-ac') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG os_vif [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d6:c8,bridge_name='br-int',has_traffic_filtering=True,id=dae63bc6-ac2b-45d5-a433-c8135bac7740,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae63bc6-ac') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6003a9f9-5e94-53ba-8235-7e46c5b331eb', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdae63bc6-ac, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdae63bc6-ac, col_values=(('qos', UUID('f0b97ac1-a40a-48d1-ab17-240eb042f240')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdae63bc6-ac, col_values=(('external_ids', {'iface-id': 'dae63bc6-ac2b-45d5-a433-c8135bac7740', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:d6:c8', 'vm-uuid': '40d7bf6c-7117-431d-9223-8b7068f58d4e'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:18 user nova-compute[75239]: INFO os_vif [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:d6:c8,bridge_name='br-int',has_traffic_filtering=True,id=dae63bc6-ac2b-45d5-a433-c8135bac7740,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae63bc6-ac')
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:43:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No VIF found with MAC fa:16:3e:07:d6:c8, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b6c812d8-c02a-4a97-8ef9-66b17a13cc32 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updating instance_info_cache with network_info: [{"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b6c812d8-c02a-4a97-8ef9-66b17a13cc32 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Releasing lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b6c812d8-c02a-4a97-8ef9-66b17a13cc32 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'flavor' on Instance uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1bf40bf-7313-43ed-879e-bca31d7cb87e req-952182fb-ccb1-45e7-9e4f-ad79a1e707ac service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-unplugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1bf40bf-7313-43ed-879e-bca31d7cb87e req-952182fb-ccb1-45e7-9e4f-ad79a1e707ac service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1bf40bf-7313-43ed-879e-bca31d7cb87e req-952182fb-ccb1-45e7-9e4f-ad79a1e707ac service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1bf40bf-7313-43ed-879e-bca31d7cb87e req-952182fb-ccb1-45e7-9e4f-ad79a1e707ac service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1bf40bf-7313-43ed-879e-bca31d7cb87e req-952182fb-ccb1-45e7-9e4f-ad79a1e707ac service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-unplugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:19 user nova-compute[75239]: WARNING nova.compute.manager [req-b1bf40bf-7313-43ed-879e-bca31d7cb87e req-952182fb-ccb1-45e7-9e4f-ad79a1e707ac service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-unplugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:43:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG nova.network.neutron [req-3caf71ab-1173-4ddd-9f37-1ed73697c28b req-2b95b8b5-702a-473c-b780-86c84857bde7 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Updated VIF entry in instance network info cache for port dae63bc6-ac2b-45d5-a433-c8135bac7740. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG nova.network.neutron [req-3caf71ab-1173-4ddd-9f37-1ed73697c28b req-2b95b8b5-702a-473c-b780-86c84857bde7 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Updating instance_info_cache with network_info: [{"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG nova.network.neutron [req-5badd69e-5137-460f-8d9f-2a3f3b9ffa7f req-00ccfc11-eea1-4e84-8b36-b4ceada5fdf0 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updated VIF entry in instance network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG nova.network.neutron [req-5badd69e-5137-460f-8d9f-2a3f3b9ffa7f req-00ccfc11-eea1-4e84-8b36-b4ceada5fdf0 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating instance_info_cache with network_info: [{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3caf71ab-1173-4ddd-9f37-1ed73697c28b req-2b95b8b5-702a-473c-b780-86c84857bde7 service nova] Releasing lock "refresh_cache-40d7bf6c-7117-431d-9223-8b7068f58d4e" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5badd69e-5137-460f-8d9f-2a3f3b9ffa7f req-00ccfc11-eea1-4e84-8b36-b4ceada5fdf0 service nova] Releasing lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:20 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Instance destroyed successfully.
Nov 13 20:43:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-ec5d4294-d3b2-421b-bc4b-48f0aaadaf04 req-cc1d7158-e555-4c23-b47c-bded003217fc service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ec5d4294-d3b2-421b-bc4b-48f0aaadaf04 req-cc1d7158-e555-4c23-b47c-bded003217fc service nova] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ec5d4294-d3b2-421b-bc4b-48f0aaadaf04 req-cc1d7158-e555-4c23-b47c-bded003217fc service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ec5d4294-d3b2-421b-bc4b-48f0aaadaf04 req-cc1d7158-e555-4c23-b47c-bded003217fc service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-ec5d4294-d3b2-421b-bc4b-48f0aaadaf04 req-cc1d7158-e555-4c23-b47c-bded003217fc service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] No waiting events found dispatching network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:20 user nova-compute[75239]: WARNING nova.compute.manager [req-ec5d4294-d3b2-421b-bc4b-48f0aaadaf04 req-cc1d7158-e555-4c23-b47c-bded003217fc service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received unexpected event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 for instance with vm_state building and task_state spawning.
Nov 13 20:43:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:21 user nova-compute[75239]: INFO nova.compute.manager [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Rebooting instance
Nov 13 20:43:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquired lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG nova.network.neutron [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-dac2ab00-c0dd-4a09-bcd7-1dc2e65e4fd9 req-99a40f87-b721-44c3-96de-831cd2f0328d service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dac2ab00-c0dd-4a09-bcd7-1dc2e65e4fd9 req-99a40f87-b721-44c3-96de-831cd2f0328d service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dac2ab00-c0dd-4a09-bcd7-1dc2e65e4fd9 req-99a40f87-b721-44c3-96de-831cd2f0328d service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dac2ab00-c0dd-4a09-bcd7-1dc2e65e4fd9 req-99a40f87-b721-44c3-96de-831cd2f0328d service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-dac2ab00-c0dd-4a09-bcd7-1dc2e65e4fd9 req-99a40f87-b721-44c3-96de-831cd2f0328d service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:21 user nova-compute[75239]: WARNING nova.compute.manager [req-dac2ab00-c0dd-4a09-bcd7-1dc2e65e4fd9 req-99a40f87-b721-44c3-96de-831cd2f0328d service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:43:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG nova.network.neutron [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating instance_info_cache with network_info: [{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Releasing lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-17bd797c-fdbb-45ed-818b-bbdd5b35a931 req-9898bbb5-6e42-4d26-bd5c-6528c8eea71d service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-unplugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-17bd797c-fdbb-45ed-818b-bbdd5b35a931 req-9898bbb5-6e42-4d26-bd5c-6528c8eea71d service nova] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-17bd797c-fdbb-45ed-818b-bbdd5b35a931 req-9898bbb5-6e42-4d26-bd5c-6528c8eea71d service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-17bd797c-fdbb-45ed-818b-bbdd5b35a931 req-9898bbb5-6e42-4d26-bd5c-6528c8eea71d service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-17bd797c-fdbb-45ed-818b-bbdd5b35a931 req-9898bbb5-6e42-4d26-bd5c-6528c8eea71d service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] No waiting events found dispatching network-vif-unplugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:22 user nova-compute[75239]: WARNING nova.compute.manager [req-17bd797c-fdbb-45ed-818b-bbdd5b35a931 req-9898bbb5-6e42-4d26-bd5c-6528c8eea71d service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received unexpected event network-vif-unplugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f for instance with vm_state active and task_state reboot_started_hard.
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-0c2e1027-a977-4ac1-a956-ab6f2372278f req-23a7be40-4549-4d2c-9acb-9f5b85d088f4 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0c2e1027-a977-4ac1-a956-ab6f2372278f req-23a7be40-4549-4d2c-9acb-9f5b85d088f4 service nova] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0c2e1027-a977-4ac1-a956-ab6f2372278f req-23a7be40-4549-4d2c-9acb-9f5b85d088f4 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0c2e1027-a977-4ac1-a956-ab6f2372278f req-23a7be40-4549-4d2c-9acb-9f5b85d088f4 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-0c2e1027-a977-4ac1-a956-ab6f2372278f req-23a7be40-4549-4d2c-9acb-9f5b85d088f4 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] No waiting events found dispatching network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:23 user nova-compute[75239]: WARNING nova.compute.manager [req-0c2e1027-a977-4ac1-a956-ab6f2372278f req-23a7be40-4549-4d2c-9acb-9f5b85d088f4 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received unexpected event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 for instance with vm_state building and task_state spawning.
Nov 13 20:43:23 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Instance destroyed successfully.
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.objects.instance [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'resources' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-449964227',display_name='tempest-TestMinimumBasicScenario-server-449964227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-449964227',id=25,image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp/zymYPzrC2cq/ApuPEOrcNJO47mKCagQFITBK4Xp20X9/7JqHfiUue4O7ur0brcNWAVqhJ6uBAft/viDg76a6W2C7ikxLv/XhEx5XTImMpMM/zOG1KHdX6M5OEb7AzQ==',key_name='tempest-TestMinimumBasicScenario-1764874526',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:41:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53fd8f58057142af8d76c28d6b7b70c6',ramdisk_id='',reservation_id='r-4exsmb4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-168427819',owner_user_name='tempest-TestMinimumBasicScenario-168427819-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:43:22Z,user_data=None,user_id='6abaa983d703498f9bcd47764794423c',uuid=ac9ac0ae-2f54-4130-aefa-17e7d36a5621,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converting VIF {"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_vif [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5265dee-cd, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7179d8db-c318-4e3d-bab1-7026adb33964) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:23 user nova-compute[75239]: INFO os_vif [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd')
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZPtAaiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:23 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1229bc83-558d-4af7-bec9-b881f0b72d30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:43:23 user nova-compute[75239]: No targets found.
Nov 13 20:43:23 user nova-compute[75239]: iSNS:
Nov 13 20:43:23 user nova-compute[75239]: No targets found.
Nov 13 20:43:23 user nova-compute[75239]: STATIC:
Nov 13 20:43:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:43:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:43:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:43:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca
Nov 13 20:43:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:43:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:43:23 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6
Nov 13 20:43:23 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:43:23 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:43:23 user nova-compute[75239]: FIRMWARE:
Nov 13 20:43:23 user nova-compute[75239]: No targets found.
Nov 13 20:43:23 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:43:23 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:43:23 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5207eb1b-07ed-4f99-8e25-9ed988227907]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4d7f1b-fdcb-4bfb-b335-ad2c2ad648f9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:23 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:23 user nova-compute[75239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:23 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:23 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:23 user nova-compute[75239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:23 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605ca9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca'): ({'sdd'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Removing single pathed devices sdd {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e31e1d8-3404-4cb4-ae08-ee3f9e14dc6c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f303e4c-6f75-4e54-8791-69785978dd6e]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Flushing IO for device /dev/sdd {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[16208609-700b-409f-8191-0781312a12d7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9233d5-e40c-424e-a2fa-8be46cf69cf6]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efd1eb6-08d6-45b7-bf62-7435896cab69]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38b2876-dc87-40ac-b108-040ba0d4911b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260]
Nov 13 20:43:23 user nova-compute[75239]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260] successful.
Nov 13 20:43:23 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:23 user nova-compute[75239]: WARNING nova.compute.manager [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:23 user nova-compute[75239]: WARNING nova.compute.manager [req-f432f49b-bae9-4eae-b67b-53b5ef4d17ab req-331e2a0b-143a-4993-9e3d-0c9033b3ae07 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f43b66-5f07-4533-ae75-ad0004a4d30f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] <== disconnect_volume: return (346ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Start _get_guest_xml network_info=[{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8b0c7e2a-f1d7-414a-9bb2-4120ee884b26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '8b0c7e2a-f1d7-414a-9bb2-4120ee884b26'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c879671b-d39b-4cb0-8f29-15837baa3806', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZPtAaiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'ac9ac0ae-2f54-4130-aefa-17e7d36a5621', 'attached_at': '', 'detached_at': '', 'volume_id': '07264292-6803-485b-b4cf-8972a13855ca', 'serial': '07264292-6803-485b-b4cf-8972a13855ca'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:43:23 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:43:23 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=8b0c7e2a-f1d7-414a-9bb2-4120ee884b26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.objects.instance [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'vcpu_model' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.objects.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Object Instance<ac9ac0ae-2f54-4130-aefa-17e7d36a5621> lazy-loaded attributes: resources,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZPtAaiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:23 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:23 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:23 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8081d89e-1f4f-4fbd-9899-da015e70bf90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:43:23 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e523742-61e2-44ee-ab40-14bbffb5d6d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca] added
Nov 13 20:43:23 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73251562-652f-4002-889b-48b7d29a406a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acbbc74-d097-4210-b115-f192243778b9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZPtAaiF {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gZPtAaiF" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd0a0aa-ad99-4ba3-9b73-68f82a3a563a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gZPtAaiF'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:23 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3accaff-9570-42d6-b61c-8eff23f6ec35]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[11671911-b678-41df-8ce1-a3dec688e584]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:24 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:24 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:24 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:24 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c57891c-c3fa-4fa0-a8d0-50f5e51580dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260]
Nov 13 20:43:24 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260] successful.
Nov 13 20:43:24 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e6c0bc-8171-4fcf-8f9f-a8d8a956b010]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6db380-77b0-4c2b-934e-ad7e86459fb6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:24 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:24 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:24 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:24 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:24 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:24 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.594s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feb2078-6f96-41d4-91f1-1e33d4f8606f]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZPtAaiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-158c2e1d-7b01-4d75-bb52-946da17978cc req-5a04ce59-4440-48d7-9fe4-99ac410c5b11 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-158c2e1d-7b01-4d75-bb52-946da17978cc req-5a04ce59-4440-48d7-9fe4-99ac410c5b11 service nova] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-158c2e1d-7b01-4d75-bb52-946da17978cc req-5a04ce59-4440-48d7-9fe4-99ac410c5b11 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-158c2e1d-7b01-4d75-bb52-946da17978cc req-5a04ce59-4440-48d7-9fe4-99ac410c5b11 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-158c2e1d-7b01-4d75-bb52-946da17978cc req-5a04ce59-4440-48d7-9fe4-99ac410c5b11 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] No waiting events found dispatching network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:24 user nova-compute[75239]: WARNING nova.compute.manager [req-158c2e1d-7b01-4d75-bb52-946da17978cc req-5a04ce59-4440-48d7-9fe4-99ac410c5b11 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received unexpected event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f for instance with vm_state active and task_state reboot_started_hard.
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:43:24 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Instance spawned successfully.
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:43:24 user nova-compute[75239]: INFO nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Took 8.25 seconds to spawn the instance on the hypervisor.
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.objects.instance [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lazy-loading 'flavor' on Instance uuid e92c1cc5-07e5-4bd2-8e58-e397e16b1300 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:24 user nova-compute[75239]: INFO nova.compute.manager [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Took 9.23 seconds to build instance.
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ece9655c-eb80-4ef1-9d37-5b2fdff89c12 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.326s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b6c812d8-c02a-4a97-8ef9-66b17a13cc32 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:25 user nova-compute[75239]: INFO nova.compute.manager [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Attaching volume 6b50271f-67dd-4e52-8842-19f690a4cd9b to /dev/vdb
Nov 13 20:43:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.628s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] <== connect_volume: return (1629ms) {'type': 'block', 'scsi_wwn': '23032353662636163', 'path': '/dev/sdd'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032353662636163', 'path': '/dev/sdd'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG os_brick.utils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-449964227',display_name='tempest-TestMinimumBasicScenario-server-449964227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-449964227',id=25,image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp/zymYPzrC2cq/ApuPEOrcNJO47mKCagQFITBK4Xp20X9/7JqHfiUue4O7ur0brcNWAVqhJ6uBAft/viDg76a6W2C7ikxLv/XhEx5XTImMpMM/zOG1KHdX6M5OEb7AzQ==',key_name='tempest-TestMinimumBasicScenario-1764874526',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:41:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53fd8f58057142af8d76c28d6b7b70c6',ramdisk_id='',reservation_id='r-4exsmb4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-168427819',owner_user_name='tempest-TestMinimumBasicScenario-168427819-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:43:22Z,user_data=None,user_id='6abaa983d703498f9bcd47764794423c',uuid=ac9ac0ae-2f54-4130-aefa-17e7d36a5621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converting VIF {"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.objects.instance [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'pci_devices' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6420b4e-9001-4c57-a4a3-99ce2ae8bdd2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.objects.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Object Instance<ac9ac0ae-2f54-4130-aefa-17e7d36a5621> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:43:25 user nova-compute[75239]:   <uuid>ac9ac0ae-2f54-4130-aefa-17e7d36a5621</uuid>
Nov 13 20:43:25 user nova-compute[75239]:   <name>instance-00000019</name>
Nov 13 20:43:25 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:43:25 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:43:25 user nova-compute[75239]:   <metadata>
Nov 13 20:43:25 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:43:25 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:43:25 user nova-compute[75239]:       <nova:name>tempest-TestMinimumBasicScenario-server-449964227</nova:name>
Nov 13 20:43:25 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:43:23</nova:creationTime>
Nov 13 20:43:25 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:43:25 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:43:25 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:43:25 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:43:25 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:43:25 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:43:25 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:43:25 user nova-compute[75239]:       <nova:owner>
Nov 13 20:43:25 user nova-compute[75239]:         <nova:user uuid="6abaa983d703498f9bcd47764794423c">tempest-TestMinimumBasicScenario-168427819-project-member</nova:user>
Nov 13 20:43:25 user nova-compute[75239]:         <nova:project uuid="53fd8f58057142af8d76c28d6b7b70c6">tempest-TestMinimumBasicScenario-168427819</nova:project>
Nov 13 20:43:25 user nova-compute[75239]:       </nova:owner>
Nov 13 20:43:25 user nova-compute[75239]:       <nova:root type="image" uuid="8b0c7e2a-f1d7-414a-9bb2-4120ee884b26"/>
Nov 13 20:43:25 user nova-compute[75239]:       <nova:ports>
Nov 13 20:43:25 user nova-compute[75239]:         <nova:port uuid="f5265dee-cd51-48a3-8c95-5b0b70e90e1f">
Nov 13 20:43:25 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 20:43:25 user nova-compute[75239]:         </nova:port>
Nov 13 20:43:25 user nova-compute[75239]:       </nova:ports>
Nov 13 20:43:25 user nova-compute[75239]:     </nova:instance>
Nov 13 20:43:25 user nova-compute[75239]:   </metadata>
Nov 13 20:43:25 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:43:25 user nova-compute[75239]:     <system>
Nov 13 20:43:25 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:43:25 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:43:25 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:43:25 user nova-compute[75239]:       <entry name="serial">ac9ac0ae-2f54-4130-aefa-17e7d36a5621</entry>
Nov 13 20:43:25 user nova-compute[75239]:       <entry name="uuid">ac9ac0ae-2f54-4130-aefa-17e7d36a5621</entry>
Nov 13 20:43:25 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:43:25 user nova-compute[75239]:     </system>
Nov 13 20:43:25 user nova-compute[75239]:   </sysinfo>
Nov 13 20:43:25 user nova-compute[75239]:   <os>
Nov 13 20:43:25 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:43:25 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:43:25 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:43:25 user nova-compute[75239]:   </os>
Nov 13 20:43:25 user nova-compute[75239]:   <features>
Nov 13 20:43:25 user nova-compute[75239]:     <acpi/>
Nov 13 20:43:25 user nova-compute[75239]:     <apic/>
Nov 13 20:43:25 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:43:25 user nova-compute[75239]:   </features>
Nov 13 20:43:25 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:43:25 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:43:25 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:43:25 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:43:25 user nova-compute[75239]:   </clock>
Nov 13 20:43:25 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:43:25 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:43:25 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:43:25 user nova-compute[75239]:   </cpu>
Nov 13 20:43:25 user nova-compute[75239]:   <devices>
Nov 13 20:43:25 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:43:25 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:43:25 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk"/>
Nov 13 20:43:25 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:43:25 user nova-compute[75239]:     </disk>
Nov 13 20:43:25 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:43:25 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:43:25 user nova-compute[75239]:       <source dev="/dev/sdd"/>
Nov 13 20:43:25 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:43:25 user nova-compute[75239]:       <serial>07264292-6803-485b-b4cf-8972a13855ca</serial>
Nov 13 20:43:25 user nova-compute[75239]:     </disk>
Nov 13 20:43:25 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:43:25 user nova-compute[75239]:       <mac address="fa:16:3e:b3:7c:48"/>
Nov 13 20:43:25 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:43:25 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:43:25 user nova-compute[75239]:       <target dev="tapf5265dee-cd"/>
Nov 13 20:43:25 user nova-compute[75239]:     </interface>
Nov 13 20:43:25 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:43:25 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/console.log" append="off"/>
Nov 13 20:43:25 user nova-compute[75239]:     </serial>
Nov 13 20:43:25 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:43:25 user nova-compute[75239]:     <video>
Nov 13 20:43:25 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:43:25 user nova-compute[75239]:     </video>
Nov 13 20:43:25 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:43:25 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:43:25 user nova-compute[75239]:     </rng>
Nov 13 20:43:25 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:43:25 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:43:25 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:43:25 user nova-compute[75239]:     </memballoon>
Nov 13 20:43:25 user nova-compute[75239]:   </devices>
Nov 13 20:43:25 user nova-compute[75239]: </domain>
Nov 13 20:43:25 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad478803-9314-497c-bd70-7fab8543110f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2383d463-0cff-4c0a-8a98-7ebd24fcef5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb4a88c-46e4-4f4f-be63-b9feabc1e0bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:43:25 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b98d3e-314c-47dd-9cab-8ab0f723b10a]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG os_brick.utils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating existing volume attachment record: 92243902-4171-4afc-9632-1171fcaef022 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-27c9c004-dec8-40e8-9ecb-4dfd94d75f3d req-678b6183-d7ee-45f5-b44a-6736b0dee29d service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-27c9c004-dec8-40e8-9ecb-4dfd94d75f3d req-678b6183-d7ee-45f5-b44a-6736b0dee29d service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing instance network info cache due to event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-27c9c004-dec8-40e8-9ecb-4dfd94d75f3d req-678b6183-d7ee-45f5-b44a-6736b0dee29d service nova] Acquiring lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-27c9c004-dec8-40e8-9ecb-4dfd94d75f3d req-678b6183-d7ee-45f5-b44a-6736b0dee29d service nova] Acquired lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.network.neutron [req-27c9c004-dec8-40e8-9ecb-4dfd94d75f3d req-678b6183-d7ee-45f5-b44a-6736b0dee29d service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.objects.instance [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'trusted_certs' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.objects.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Object Instance<ac9ac0ae-2f54-4130-aefa-17e7d36a5621> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.network.neutron [req-27c9c004-dec8-40e8-9ecb-4dfd94d75f3d req-678b6183-d7ee-45f5-b44a-6736b0dee29d service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updated VIF entry in instance network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:43:25 user nova-compute[75239]: DEBUG nova.network.neutron [req-27c9c004-dec8-40e8-9ecb-4dfd94d75f3d req-678b6183-d7ee-45f5-b44a-6736b0dee29d service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-27c9c004-dec8-40e8-9ecb-4dfd94d75f3d req-678b6183-d7ee-45f5-b44a-6736b0dee29d service nova] Releasing lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Cannot resize image /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG nova.objects.instance [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'migration_context' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG nova.objects.base [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Object Instance<ac9ac0ae-2f54-4130-aefa-17e7d36a5621> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-449964227',display_name='tempest-TestMinimumBasicScenario-server-449964227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-449964227',id=25,image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp/zymYPzrC2cq/ApuPEOrcNJO47mKCagQFITBK4Xp20X9/7JqHfiUue4O7ur0brcNWAVqhJ6uBAft/viDg76a6W2C7ikxLv/XhEx5XTImMpMM/zOG1KHdX6M5OEb7AzQ==',key_name='tempest-TestMinimumBasicScenario-1764874526',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:41:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='53fd8f58057142af8d76c28d6b7b70c6',ramdisk_id='',reservation_id='r-4exsmb4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-168427819',owner_user_name='tempest-TestMinimumBasicScenario-168427819-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:43:22Z,user_data=None,user_id='6abaa983d703498f9bcd47764794423c',uuid=ac9ac0ae-2f54-4130-aefa-17e7d36a5621,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converting VIF {"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG os_vif [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83e8cd05-f7ca-5d96-a084-0538ab14c1f4', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5265dee-cd, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5265dee-cd, col_values=(('qos', UUID('558a81e2-7bea-4e53-914a-f5ebfbceadd4')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5265dee-cd, col_values=(('external_ids', {'iface-id': 'f5265dee-cd51-48a3-8c95-5b0b70e90e1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:7c:48', 'vm-uuid': 'ac9ac0ae-2f54-4130-aefa-17e7d36a5621'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:43:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:26 user nova-compute[75239]: INFO os_vif [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd')
Nov 13 20:43:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:27 user nova-compute[75239]: INFO nova.compute.manager [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Shelve offloading
Nov 13 20:43:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-bf163128-2020-4085-ae31-26cf01bc4bc0 req-7ab21cea-17bc-44b0-910a-1d52aa4e759d service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-unplugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bf163128-2020-4085-ae31-26cf01bc4bc0 req-7ab21cea-17bc-44b0-910a-1d52aa4e759d service nova] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bf163128-2020-4085-ae31-26cf01bc4bc0 req-7ab21cea-17bc-44b0-910a-1d52aa4e759d service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bf163128-2020-4085-ae31-26cf01bc4bc0 req-7ab21cea-17bc-44b0-910a-1d52aa4e759d service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-bf163128-2020-4085-ae31-26cf01bc4bc0 req-7ab21cea-17bc-44b0-910a-1d52aa4e759d service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] No waiting events found dispatching network-vif-unplugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:27 user nova-compute[75239]: WARNING nova.compute.manager [req-bf163128-2020-4085-ae31-26cf01bc4bc0 req-7ab21cea-17bc-44b0-910a-1d52aa4e759d service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received unexpected event network-vif-unplugged-0b40e357-282b-4698-9af6-41acd4aa408b for instance with vm_state active and task_state shelving.
Nov 13 20:43:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Instance destroyed successfully.
Nov 13 20:43:28 user nova-compute[75239]: DEBUG nova.compute.manager [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquired lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Releasing lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:29 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Instance destroyed successfully.
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lazy-loading 'resources' on Instance uuid d6efe568-bf8d-4342-bb0e-0a878f7cccf3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1104629884',display_name='tempest-TestShelveInstance-server-1104629884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1104629884',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIKH+oCJ3NUeycdEu6o0ACiWfJa/kxXrNTIHezDCjZ4hZvwPmJKxpD3DthYAcv9iLh2oZ3SAgjtnpJ0CtwHOrOkHMhfLVc1u+0r3+jR3oH11gC8/uAbwmubEO5JCg7CFQ==',key_name='tempest-TestShelveInstance-438861881',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:41:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4a480ab579c451799fbaac4af653379',ramdisk_id='',reservation_id='r-febrlktk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1910953819',owner_user_name='tempest-TestShelveInstance-1910953819-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:41:45Z,user_data=None,user_id='41ee3d20cab9440d9564a3b536668fda',uuid=d6efe568-bf8d-4342-bb0e-0a878f7cccf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converting VIF {"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_vif [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b40e357-28, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-21980f09-f313-4f9c-93a0-47f7cb516e7d req-b306b8c3-d9f9-4442-afc8-896597a8f3c1 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-21980f09-f313-4f9c-93a0-47f7cb516e7d req-b306b8c3-d9f9-4442-afc8-896597a8f3c1 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing instance network info cache due to event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21980f09-f313-4f9c-93a0-47f7cb516e7d req-b306b8c3-d9f9-4442-afc8-896597a8f3c1 service nova] Acquiring lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21980f09-f313-4f9c-93a0-47f7cb516e7d req-b306b8c3-d9f9-4442-afc8-896597a8f3c1 service nova] Acquired lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.network.neutron [req-21980f09-f313-4f9c-93a0-47f7cb516e7d req-b306b8c3-d9f9-4442-afc8-896597a8f3c1 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=129e27e0-c31b-42eb-8f71-63a3b8046b8a) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:43:29 user nova-compute[75239]: INFO os_vif [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28')
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] No waiting events found dispatching network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:29 user nova-compute[75239]: WARNING nova.compute.manager [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received unexpected event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b for instance with vm_state active and task_state shelving.
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] No waiting events found dispatching network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:29 user nova-compute[75239]: WARNING nova.compute.manager [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received unexpected event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f for instance with vm_state active and task_state reboot_started_hard.
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] No waiting events found dispatching network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:29 user nova-compute[75239]: WARNING nova.compute.manager [req-90abbc5c-89c7-4f41-8d52-c8d48b5f27c4 req-c252c3aa-cf8f-4b2f-ad2d-7445c4bfaa10 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received unexpected event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f for instance with vm_state active and task_state reboot_started_hard.
Nov 13 20:43:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKRGSQhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:29 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ab211-34fe-46c3-ae5e-493b3b34528f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:43:29 user nova-compute[75239]: No targets found.
Nov 13 20:43:29 user nova-compute[75239]: iSNS:
Nov 13 20:43:29 user nova-compute[75239]: No targets found.
Nov 13 20:43:29 user nova-compute[75239]: STATIC:
Nov 13 20:43:29 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:43:29 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:43:29 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:43:29 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca
Nov 13 20:43:29 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:43:29 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:43:29 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6
Nov 13 20:43:29 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:43:29 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:43:29 user nova-compute[75239]: FIRMWARE:
Nov 13 20:43:29 user nova-compute[75239]: No targets found.
Nov 13 20:43:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:43:29 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:43:29 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff797f5-dcef-4115-a360-5c144e3537af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6bffc8-567c-4cbc-ae16-efa420a0470b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:29 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:29 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:29 user nova-compute[75239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:43:29 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d84384670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e834ba7-6c20-409f-89c3-1c50d91901a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98afc46-7a0b-4615-a42c-8cf2522e5d93]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[07177082-a802-4e6c-a14d-fce04091331b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cec2d8-1c8d-46f1-a397-bcdebea6b851]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[319db8f8-c65e-4ba5-91e7-37d3acc2a77a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7816e0b-e435-490d-911b-ed16ca3426cd]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260]
Nov 13 20:43:29 user nova-compute[75239]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260] successful.
Nov 13 20:43:29 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8eafaa-5b9c-41df-b54b-8311d58a1e80]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] <== disconnect_volume: return (356ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:43:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Deleting instance files /opt/stack/data/nova/instances/d6efe568-bf8d-4342-bb0e-0a878f7cccf3_del
Nov 13 20:43:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Deletion of /opt/stack/data/nova/instances/d6efe568-bf8d-4342-bb0e-0a878f7cccf3_del complete
Nov 13 20:43:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-21980f09-f313-4f9c-93a0-47f7cb516e7d req-b306b8c3-d9f9-4442-afc8-896597a8f3c1 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updated VIF entry in instance network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-21980f09-f313-4f9c-93a0-47f7cb516e7d req-b306b8c3-d9f9-4442-afc8-896597a8f3c1 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": null, "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0b40e357-28", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21980f09-f313-4f9c-93a0-47f7cb516e7d req-b306b8c3-d9f9-4442-afc8-896597a8f3c1 service nova] Releasing lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:30 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:30 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:30 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d0b2f7-183a-4ee3-a117-04e4a4ab765a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:43:30 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f86efca-3896-4a20-a66b-b9f180af37f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b] added
Nov 13 20:43:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc0e265-c796-4046-ba3b-b9e747ac5162]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG nova.compute.manager [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc75dec-d76d-4dd5-b0de-7e29fdfbc38f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrmTOSFB {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Instance rebooted successfully.
Nov 13 20:43:30 user nova-compute[75239]: DEBUG nova.compute.manager [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrmTOSFB" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[014246d1-af7b-497a-ac3c-e8afe1fd2161]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrmTOSFB'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[862df311-72f9-4722-9f59-fceb1eea8399]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2572137-26c9-4cea-82b9-a9e19fc2aecf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:30 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:30 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-73f52ace-d39d-433a-8c6d-1ffa8f3c1d74 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.412s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee299e0c-718c-4d60-8bc5-e4ee18e12277]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]
Nov 13 20:43:30 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.
Nov 13 20:43:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[217b4ae3-f7f9-4275-8e94-d88e20e6dfcd]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2882e531-3714-490d-9ba4-c954f7d63caa]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:30 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:30 user nova-compute[75239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:43:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:30 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:30 user nova-compute[75239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:43:30 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c61350e-4dc0-44ce-bebc-51c1bfe22188]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:43:30 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:43:31 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Deleted allocations for instance d6efe568-bf8d-4342-bb0e-0a878f7cccf3
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lazy-loading 'numa_topology' on Instance uuid d6efe568-bf8d-4342-bb0e-0a878f7cccf3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG nova.objects.base [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Object Instance<d6efe568-bf8d-4342-bb0e-0a878f7cccf3> lazy-loaded attributes: resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.242s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b7a02490-9fdd-43f5-9041-11202b41ba88 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.504s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26565303163353563', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565303163353563', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lazy-loading 'flavor' on Instance uuid e92c1cc5-07e5-4bd2-8e58-e397e16b1300 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:43:31 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:43:31 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:43:31 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:43:31 user nova-compute[75239]:   <serial>6b50271f-67dd-4e52-8842-19f690a4cd9b</serial>
Nov 13 20:43:31 user nova-compute[75239]: </disk>
Nov 13 20:43:31 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] No VIF found with MAC fa:16:3e:13:86:a6, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3f9a6956-ff3a-434a-94f8-1fda64e99d06 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.281s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Stashing vm_state: active {{(pid=75239) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:43:34 user nova-compute[75239]: INFO nova.compute.claims [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Claim successful on node user
Nov 13 20:43:34 user nova-compute[75239]: INFO nova.compute.resource_tracker [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating resource usage from migration a3295796-2e28-4571-be82-dd0701892400
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:34 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.799s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:35 user nova-compute[75239]: INFO nova.compute.manager [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Migrating
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:35 user nova-compute[75239]: INFO nova.compute.rpcapi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquired lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating instance_info_cache with network_info: [{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Releasing lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Starting migrate_disk_and_power_off {{(pid=75239) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-f42eb98c-4d91-41fa-ab1f-5c7af2ec850e req-e9d29bf5-fdb1-4a9f-b226-6e57fb009d10 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-unplugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f42eb98c-4d91-41fa-ab1f-5c7af2ec850e req-e9d29bf5-fdb1-4a9f-b226-6e57fb009d10 service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f42eb98c-4d91-41fa-ab1f-5c7af2ec850e req-e9d29bf5-fdb1-4a9f-b226-6e57fb009d10 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f42eb98c-4d91-41fa-ab1f-5c7af2ec850e req-e9d29bf5-fdb1-4a9f-b226-6e57fb009d10 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-f42eb98c-4d91-41fa-ab1f-5c7af2ec850e req-e9d29bf5-fdb1-4a9f-b226-6e57fb009d10 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-unplugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:36 user nova-compute[75239]: WARNING nova.compute.manager [req-f42eb98c-4d91-41fa-ab1f-5c7af2ec850e req-e9d29bf5-fdb1-4a9f-b226-6e57fb009d10 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-unplugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state active and task_state resize_migrating.
Nov 13 20:43:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:43:37 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7485MB free_disk=24.72661590576172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance destroyed successfully.
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-16569669',display_name='tempest-ServerActionsTestOtherB-server-16569669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-16569669',id=22,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3cgFTuxZU0r1DOz9OMgd6sE59YAs74F2EMnqYDQDB93Sr2devQa1xYepd0PJ2KrqjVYzoEFlJaWxo0ebxb5mBVEX1HkJ8Mn4KaHB/8mBjirpfPmOT2iYwed690kLau+A==',key_name='tempest-keypair-1787385900',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:39:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f4d33674f2f4221a2a17f5510135ba8',ramdisk_id='',reservation_id='r-cxa24fp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-94146296',owner_user_name='tempest-ServerActionsTestOtherB-94146296-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c880ecddd16344ae92fdd8916db586d5',uuid=e92c1cc5-07e5-4bd2-8e58-e397e16b1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1607150608-network", "vif_mac": "fa:16:3e:13:86:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converting VIF {"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1607150608-network", "vif_mac": "fa:16:3e:13:86:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_vif [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap112c3460-96, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c44645ea-0741-4a42-9634-26bebb3f65bc) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:37 user nova-compute[75239]: INFO os_vif [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96')
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:37 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eb4484-1388-4a7f-9212-1034e4579f62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:43:37 user nova-compute[75239]: No targets found.
Nov 13 20:43:37 user nova-compute[75239]: iSNS:
Nov 13 20:43:37 user nova-compute[75239]: No targets found.
Nov 13 20:43:37 user nova-compute[75239]: STATIC:
Nov 13 20:43:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:43:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:43:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:43:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca
Nov 13 20:43:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:43:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:43:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b
Nov 13 20:43:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:43:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:43:37 user nova-compute[75239]: FIRMWARE:
Nov 13 20:43:37 user nova-compute[75239]: No targets found.
Nov 13 20:43:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:43:37 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:43:37 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8f61f3-4760-4965-a745-e2d91d2a0c98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[035ed9c5-b7e3-4847-8070-cece6813fd9e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:37 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:37 user nova-compute[75239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:43:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:37 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:37 user nova-compute[75239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:43:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d603e3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[375c223a-77c2-45ef-b35a-eb830f3a9e97]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Applying migration context for instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 as it has an incoming, in-progress migration a3295796-2e28-4571-be82-dd0701892400. Migration status is migrating {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 20:43:37 user nova-compute[75239]: INFO nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating resource usage from migration a3295796-2e28-4571-be82-dd0701892400
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[faee69ce-c36d-481d-a041-4dd5e0d86aa3]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7738ff78-7e9a-46f7-a0d1-c6d47d1b7d8d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1ec27628-db61-49c0-951b-6e72ac2f4f15 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance b24f2bf2-0c75-49c3-acce-c811f5454d8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 7525c321-c164-4d14-8364-23f07eb826b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 40d7bf6c-7117-431d-9223-8b7068f58d4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Migration a3295796-2e28-4571-be82-dd0701892400 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fa68a3-e088-4abd-8126-d18056fa951a]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5807774-bd0a-4ab7-9b5f-518808619ca4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[773c374a-699c-4775-808b-01097643d68d]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]
Nov 13 20:43:37 user nova-compute[75239]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.
Nov 13 20:43:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[537092e5-ddde-4ad0-94ae-8cc1f5169aee]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] <== disconnect_volume: return (342ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.719s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300_resize/disk /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-64b19625-6f11-4d8b-9a9e-f6512867b88e req-6c333ce2-10f6-4091-a264-ff6e814793cd service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-64b19625-6f11-4d8b-9a9e-f6512867b88e req-6c333ce2-10f6-4091-a264-ff6e814793cd service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-64b19625-6f11-4d8b-9a9e-f6512867b88e req-6c333ce2-10f6-4091-a264-ff6e814793cd service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-64b19625-6f11-4d8b-9a9e-f6512867b88e req-6c333ce2-10f6-4091-a264-ff6e814793cd service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-64b19625-6f11-4d8b-9a9e-f6512867b88e req-6c333ce2-10f6-4091-a264-ff6e814793cd service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:38 user nova-compute[75239]: WARNING nova.compute.manager [req-64b19625-6f11-4d8b-9a9e-f6512867b88e req-6c333ce2-10f6-4091-a264-ff6e814793cd service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state active and task_state resize_migrating.
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "cp -r /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300_resize/disk /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk" returned: 0 in 0.395s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300_resize/disk.info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk.info {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "cp -r /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300_resize/disk.info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk.info" returned: 0 in 0.036s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Port 112c3460-96e2-4760-b161-d7a6fd9b3535 binding to destination host user is already ACTIVE {{(pid=75239) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquired lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updating instance_info_cache with network_info: [{"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating instance_info_cache with network_info: [{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Releasing lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG os_brick.utils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f576a96-01e4-4e1a-ba72-b18942b73f74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[359ebc8f-571c-4bd7-aa10-f8d735b1d4be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ef0f7a-15a8-4f8e-91e7-fb9083ea701f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[827994e6-0df3-441b-afa5-f01d622a03f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:43:40 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:43:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff147e4-72a3-4dc1-8087-906ca0fab800]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:43:40 user nova-compute[75239]: DEBUG os_brick.utils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Starting finish_migration {{(pid=75239) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 20:43:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance directory exists: not creating {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 20:43:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Creating image(s)
Nov 13 20:43:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:44 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk. size=21474836480 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:43:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk 21474836480 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk 21474836480" returned: 0 in 0.233s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Ensure instance console log exists: /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Start _get_guest_xml network_info=[{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1607150608-network", "vif_mac": "fa:16:3e:13:86:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '79180fb2-2f06-4e97-aa70-dd98843c2626', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e92c1cc5-07e5-4bd2-8e58-e397e16b1300', 'attached_at': '2023-11-13T20:43:45.000000', 'detached_at': '', 'volume_id': '6b50271f-67dd-4e52-8842-19f690a4cd9b', 'serial': '6b50271f-67dd-4e52-8842-19f690a4cd9b'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:43:45 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:43:45 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:45 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:45 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:43:45 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d87b51-6fdc-4165-ba1c-bb52a1007b36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:43:45 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee4830e-f164-4686-892b-9e178a4b531c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b] added
Nov 13 20:43:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3c585-0786-4e74-9a80-38fa3bb812d5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25d63e8-5b60-4bc1-89b4-d82f4959dde6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrmTOSFB {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrmTOSFB" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c68336-93c7-48a0-91aa-f9cd92c369cc]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrmTOSFB'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[28af1b6f-c930-40ce-a00d-2ba802908913]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf1af15-6b85-47d6-9fb5-fc1004aeb10e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:45 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:45 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d828ca-f8f5-408a-b2e1-25555322fa16]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]
Nov 13 20:43:45 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.
Nov 13 20:43:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f734dd9a-4179-4f1b-8922-1104da147f43]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac13c1e-21ec-4758-bcc6-b591af40d9f3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:45 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:45 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:43:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:43:45 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:43:45 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:43:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34afa5-76aa-4b28-ae0a-9344d0a03ae4]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:43:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26565303163353563', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565303163353563', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-16569669',display_name='tempest-ServerActionsTestOtherB-server-16569669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-16569669',id=22,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3cgFTuxZU0r1DOz9OMgd6sE59YAs74F2EMnqYDQDB93Sr2devQa1xYepd0PJ2KrqjVYzoEFlJaWxo0ebxb5mBVEX1HkJ8Mn4KaHB/8mBjirpfPmOT2iYwed690kLau+A==',key_name='tempest-keypair-1787385900',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:39:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f4d33674f2f4221a2a17f5510135ba8',ramdisk_id='',reservation_id='r-cxa24fp9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-94146296',owner_user_name='tempest-ServerActionsTestOtherB-94146296-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c880ecddd16344ae92fdd8916db586d5',uuid=e92c1cc5-07e5-4bd2-8e58-e397e16b1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1607150608-network", "vif_mac": "fa:16:3e:13:86:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converting VIF {"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1607150608-network", "vif_mac": "fa:16:3e:13:86:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:43:46 user nova-compute[75239]:   <uuid>e92c1cc5-07e5-4bd2-8e58-e397e16b1300</uuid>
Nov 13 20:43:46 user nova-compute[75239]:   <name>instance-00000016</name>
Nov 13 20:43:46 user nova-compute[75239]:   <memory>2097152</memory>
Nov 13 20:43:46 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:43:46 user nova-compute[75239]:   <metadata>
Nov 13 20:43:46 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:43:46 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:43:46 user nova-compute[75239]:       <nova:name>tempest-ServerActionsTestOtherB-server-16569669</nova:name>
Nov 13 20:43:46 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:43:45</nova:creationTime>
Nov 13 20:43:46 user nova-compute[75239]:       <nova:flavor name="m1.small">
Nov 13 20:43:46 user nova-compute[75239]:         <nova:memory>2048</nova:memory>
Nov 13 20:43:46 user nova-compute[75239]:         <nova:disk>20</nova:disk>
Nov 13 20:43:46 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:43:46 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:43:46 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:43:46 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:43:46 user nova-compute[75239]:       <nova:owner>
Nov 13 20:43:46 user nova-compute[75239]:         <nova:user uuid="c880ecddd16344ae92fdd8916db586d5">tempest-ServerActionsTestOtherB-94146296-project-member</nova:user>
Nov 13 20:43:46 user nova-compute[75239]:         <nova:project uuid="0f4d33674f2f4221a2a17f5510135ba8">tempest-ServerActionsTestOtherB-94146296</nova:project>
Nov 13 20:43:46 user nova-compute[75239]:       </nova:owner>
Nov 13 20:43:46 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:43:46 user nova-compute[75239]:       <nova:ports>
Nov 13 20:43:46 user nova-compute[75239]:         <nova:port uuid="112c3460-96e2-4760-b161-d7a6fd9b3535">
Nov 13 20:43:46 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:43:46 user nova-compute[75239]:         </nova:port>
Nov 13 20:43:46 user nova-compute[75239]:       </nova:ports>
Nov 13 20:43:46 user nova-compute[75239]:     </nova:instance>
Nov 13 20:43:46 user nova-compute[75239]:   </metadata>
Nov 13 20:43:46 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:43:46 user nova-compute[75239]:     <system>
Nov 13 20:43:46 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:43:46 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:43:46 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:43:46 user nova-compute[75239]:       <entry name="serial">e92c1cc5-07e5-4bd2-8e58-e397e16b1300</entry>
Nov 13 20:43:46 user nova-compute[75239]:       <entry name="uuid">e92c1cc5-07e5-4bd2-8e58-e397e16b1300</entry>
Nov 13 20:43:46 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:43:46 user nova-compute[75239]:     </system>
Nov 13 20:43:46 user nova-compute[75239]:   </sysinfo>
Nov 13 20:43:46 user nova-compute[75239]:   <os>
Nov 13 20:43:46 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:43:46 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:43:46 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:43:46 user nova-compute[75239]:   </os>
Nov 13 20:43:46 user nova-compute[75239]:   <features>
Nov 13 20:43:46 user nova-compute[75239]:     <acpi/>
Nov 13 20:43:46 user nova-compute[75239]:     <apic/>
Nov 13 20:43:46 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:43:46 user nova-compute[75239]:   </features>
Nov 13 20:43:46 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:43:46 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:43:46 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:43:46 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:43:46 user nova-compute[75239]:   </clock>
Nov 13 20:43:46 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:43:46 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:43:46 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:43:46 user nova-compute[75239]:   </cpu>
Nov 13 20:43:46 user nova-compute[75239]:   <devices>
Nov 13 20:43:46 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:43:46 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:43:46 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk"/>
Nov 13 20:43:46 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:43:46 user nova-compute[75239]:     </disk>
Nov 13 20:43:46 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:43:46 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:43:46 user nova-compute[75239]:       <source dev="/dev/sdc"/>
Nov 13 20:43:46 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:43:46 user nova-compute[75239]:       <serial>6b50271f-67dd-4e52-8842-19f690a4cd9b</serial>
Nov 13 20:43:46 user nova-compute[75239]:     </disk>
Nov 13 20:43:46 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:43:46 user nova-compute[75239]:       <mac address="fa:16:3e:13:86:a6"/>
Nov 13 20:43:46 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:43:46 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:43:46 user nova-compute[75239]:       <target dev="tap112c3460-96"/>
Nov 13 20:43:46 user nova-compute[75239]:     </interface>
Nov 13 20:43:46 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:43:46 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/console.log" append="off"/>
Nov 13 20:43:46 user nova-compute[75239]:     </serial>
Nov 13 20:43:46 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:43:46 user nova-compute[75239]:     <video>
Nov 13 20:43:46 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:43:46 user nova-compute[75239]:     </video>
Nov 13 20:43:46 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:43:46 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:43:46 user nova-compute[75239]:     </rng>
Nov 13 20:43:46 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:43:46 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:43:46 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:43:46 user nova-compute[75239]:     </memballoon>
Nov 13 20:43:46 user nova-compute[75239]:   </devices>
Nov 13 20:43:46 user nova-compute[75239]: </domain>
Nov 13 20:43:46 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-16569669',display_name='tempest-ServerActionsTestOtherB-server-16569669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-16569669',id=22,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3cgFTuxZU0r1DOz9OMgd6sE59YAs74F2EMnqYDQDB93Sr2devQa1xYepd0PJ2KrqjVYzoEFlJaWxo0ebxb5mBVEX1HkJ8Mn4KaHB/8mBjirpfPmOT2iYwed690kLau+A==',key_name='tempest-keypair-1787385900',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:39:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f4d33674f2f4221a2a17f5510135ba8',ramdisk_id='',reservation_id='r-cxa24fp9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-94146296',owner_user_name='tempest-ServerActionsTestOtherB-94146296-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c880ecddd16344ae92fdd8916db586d5',uuid=e92c1cc5-07e5-4bd2-8e58-e397e16b1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1607150608-network", "vif_mac": "fa:16:3e:13:86:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converting VIF {"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1607150608-network", "vif_mac": "fa:16:3e:13:86:a6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG os_vif [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de48b76b-f3c1-5fb9-a92f-e187e43e3ade', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap112c3460-96, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap112c3460-96, col_values=(('qos', UUID('bf88c687-5db0-4a45-a82c-3305541ef334')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap112c3460-96, col_values=(('external_ids', {'iface-id': '112c3460-96e2-4760-b161-d7a6fd9b3535', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:86:a6', 'vm-uuid': 'e92c1cc5-07e5-4bd2-8e58-e397e16b1300'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:46 user nova-compute[75239]: INFO os_vif [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96')
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:43:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] No VIF found with MAC fa:16:3e:13:86:a6, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:43:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-c48dae89-1a7d-445e-b8be-b31ed6dc7bf7 req-a22ff904-7161-4b15-9454-21a35a00e470 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c48dae89-1a7d-445e-b8be-b31ed6dc7bf7 req-a22ff904-7161-4b15-9454-21a35a00e470 service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c48dae89-1a7d-445e-b8be-b31ed6dc7bf7 req-a22ff904-7161-4b15-9454-21a35a00e470 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c48dae89-1a7d-445e-b8be-b31ed6dc7bf7 req-a22ff904-7161-4b15-9454-21a35a00e470 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-c48dae89-1a7d-445e-b8be-b31ed6dc7bf7 req-a22ff904-7161-4b15-9454-21a35a00e470 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:48 user nova-compute[75239]: WARNING nova.compute.manager [req-c48dae89-1a7d-445e-b8be-b31ed6dc7bf7 req-a22ff904-7161-4b15-9454-21a35a00e470 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state active and task_state resize_finish.
Nov 13 20:43:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:43:50 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance running successfully.
Nov 13 20:43:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Failed to set time: agent not configured {{(pid=75239) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 20:43:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6fb70096-650a-4c0b-b0b3-b19ca36a97db tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] finish_migration finished successfully. {{(pid=75239) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 20:43:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-5ae8fcac-9a1e-4e04-926a-9f81ad23aa88 req-4ccbfa5b-1001-4045-8fe4-f4d077e86488 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:43:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5ae8fcac-9a1e-4e04-926a-9f81ad23aa88 req-4ccbfa5b-1001-4045-8fe4-f4d077e86488 service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5ae8fcac-9a1e-4e04-926a-9f81ad23aa88 req-4ccbfa5b-1001-4045-8fe4-f4d077e86488 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5ae8fcac-9a1e-4e04-926a-9f81ad23aa88 req-4ccbfa5b-1001-4045-8fe4-f4d077e86488 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-5ae8fcac-9a1e-4e04-926a-9f81ad23aa88 req-4ccbfa5b-1001-4045-8fe4-f4d077e86488 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:43:50 user nova-compute[75239]: WARNING nova.compute.manager [req-5ae8fcac-9a1e-4e04-926a-9f81ad23aa88 req-4ccbfa5b-1001-4045-8fe4-f4d077e86488 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state resized and task_state None.
Nov 13 20:43:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:43:58 user nova-compute[75239]: INFO nova.compute.claims [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Claim successful on node user
Nov 13 20:43:58 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:43:58 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:43:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:43:58 user nova-compute[75239]: DEBUG nova.policy [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d8ae2d158f94548bc3d9873317935cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14ce616b1ad4ee7934e34bad1fdf6a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:43:58 user nova-compute[75239]: INFO nova.virt.block_device [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Booting with volume 3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 at /dev/vda
Nov 13 20:43:59 user nova-compute[75239]: DEBUG os_brick.utils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb5fb1b-249b-4d68-a1a4-bc8d1b525da7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f1c93-7f63-4734-b91a-94289e6a30c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37e1c05-bebd-48b6-afd6-d9fdafe177ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c89a7d-74f0-4a14-8a9e-09834ffb5691]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:43:59 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:43:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1121f5-24fa-4f7f-92ed-51cff00814d8]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG os_brick.utils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating existing volume attachment record: 5c83fab6-4cae-401b-bdc5-ca32d307bfd7 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:43:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Successfully created port: c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:44:00 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Successfully updated port: c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:44:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquired lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:00 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:44:00 user nova-compute[75239]: DEBUG nova.compute.manager [req-cf629a04-55a3-4eb2-9fc8-83b30e4820ed req-fdfa7e73-6bd5-4e3c-a07c-fffc0802b7e3 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-changed-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:00 user nova-compute[75239]: DEBUG nova.compute.manager [req-cf629a04-55a3-4eb2-9fc8-83b30e4820ed req-fdfa7e73-6bd5-4e3c-a07c-fffc0802b7e3 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Refreshing instance network info cache due to event network-changed-c81078b8-09c9-413f-8166-acd8fa285a00. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:44:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cf629a04-55a3-4eb2-9fc8-83b30e4820ed req-fdfa7e73-6bd5-4e3c-a07c-fffc0802b7e3 service nova] Acquiring lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:00 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:44:00 user nova-compute[75239]: DEBUG nova.network.neutron [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating instance_info_cache with network_info: [{"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Releasing lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Instance network_info: |[{"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:44:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cf629a04-55a3-4eb2-9fc8-83b30e4820ed req-fdfa7e73-6bd5-4e3c-a07c-fffc0802b7e3 service nova] Acquired lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:01 user nova-compute[75239]: DEBUG nova.network.neutron [req-cf629a04-55a3-4eb2-9fc8-83b30e4820ed req-fdfa7e73-6bd5-4e3c-a07c-fffc0802b7e3 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Refreshing network info cache for port c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:44:01 user nova-compute[75239]: DEBUG nova.network.neutron [req-cf629a04-55a3-4eb2-9fc8-83b30e4820ed req-fdfa7e73-6bd5-4e3c-a07c-fffc0802b7e3 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updated VIF entry in instance network info cache for port c81078b8-09c9-413f-8166-acd8fa285a00. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:44:01 user nova-compute[75239]: DEBUG nova.network.neutron [req-cf629a04-55a3-4eb2-9fc8-83b30e4820ed req-fdfa7e73-6bd5-4e3c-a07c-fffc0802b7e3 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating instance_info_cache with network_info: [{"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cf629a04-55a3-4eb2-9fc8-83b30e4820ed req-fdfa7e73-6bd5-4e3c-a07c-fffc0802b7e3 service nova] Releasing lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:44:03 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Creating image(s)
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Ensure instance console log exists: /opt/stack/data/nova/instances/e62931e3-90bb-4959-825c-e80dfc391989/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Start _get_guest_xml network_info=[{"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5c83fab6-4cae-401b-bdc5-ca32d307bfd7', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wORodVyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e62931e3-90bb-4959-825c-e80dfc391989', 'attached_at': '', 'detached_at': '', 'volume_id': '3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'serial': '3a60d3dd-39ef-42d4-9c16-d13ccdea60c9'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:44:03 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:44:03 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wORodVyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:44:03 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:44:03 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:44:03 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2314dcc0-cc3d-4cca-9bd3-36e49e2cdbba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:44:03 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfeb132-3279-4d16-b23a-1763a3c7ed59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9] added
Nov 13 20:44:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[647bb523-7887-4766-b471-d3782ef6868c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed9ac1b-2993-46ef-8cb2-476a74d36203]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wORodVyS {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wORodVyS" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba24e6df-6bf3-4f44-a12b-bf2ae913f570]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wORodVyS'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[979d67fc-df6e-470a-877a-ee904553f48e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c7b853-7d84-4544-9b34-61763e5af084]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5b91e3-8830-48ae-93d6-565bef6d5e73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260]
Nov 13 20:44:03 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260] successful.
Nov 13 20:44:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[07edd62d-c0af-4a6f-a8ae-747e7c5af5ca]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b755c7f4-294e-442c-9743-9bb84303b509]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:03 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:03 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[998b0716-d905-4191-85cb-787e33693801]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:44:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wORodVyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '26533633130373631', 'path': '/dev/sde'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533633130373631', 'path': '/dev/sde'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1277596519',display_name='tempest-ServerActionsTestOtherA-server-1277596519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1277596519',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx37q9vY0QYlo3fI5aFH9X6d2hNyPjTGXNNUmCr6ibGa/Kc1ClaPlhMidaIIsV7Y1igpikXwuCDpafpWPc5/9hzW0qq+/XK1xQPQ4kHZy5qMv84+zHN9XJn4hcGarD9Lw==',key_name='tempest-keypair-1127026760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-qvsenhs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=e62931e3-90bb-4959-825c-e80dfc391989,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'pci_devices' on Instance uuid e62931e3-90bb-4959-825c-e80dfc391989 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:44:04 user nova-compute[75239]:   <uuid>e62931e3-90bb-4959-825c-e80dfc391989</uuid>
Nov 13 20:44:04 user nova-compute[75239]:   <name>instance-0000001e</name>
Nov 13 20:44:04 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:44:04 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:44:04 user nova-compute[75239]:   <metadata>
Nov 13 20:44:04 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:44:04 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:44:04 user nova-compute[75239]:       <nova:name>tempest-ServerActionsTestOtherA-server-1277596519</nova:name>
Nov 13 20:44:04 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:44:03</nova:creationTime>
Nov 13 20:44:04 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:44:04 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:44:04 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:44:04 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:44:04 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:44:04 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:44:04 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:44:04 user nova-compute[75239]:       <nova:owner>
Nov 13 20:44:04 user nova-compute[75239]:         <nova:user uuid="3d8ae2d158f94548bc3d9873317935cd">tempest-ServerActionsTestOtherA-1210141142-project-member</nova:user>
Nov 13 20:44:04 user nova-compute[75239]:         <nova:project uuid="e14ce616b1ad4ee7934e34bad1fdf6a3">tempest-ServerActionsTestOtherA-1210141142</nova:project>
Nov 13 20:44:04 user nova-compute[75239]:       </nova:owner>
Nov 13 20:44:04 user nova-compute[75239]:       <nova:ports>
Nov 13 20:44:04 user nova-compute[75239]:         <nova:port uuid="c81078b8-09c9-413f-8166-acd8fa285a00">
Nov 13 20:44:04 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:44:04 user nova-compute[75239]:         </nova:port>
Nov 13 20:44:04 user nova-compute[75239]:       </nova:ports>
Nov 13 20:44:04 user nova-compute[75239]:     </nova:instance>
Nov 13 20:44:04 user nova-compute[75239]:   </metadata>
Nov 13 20:44:04 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:44:04 user nova-compute[75239]:     <system>
Nov 13 20:44:04 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:44:04 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:44:04 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:44:04 user nova-compute[75239]:       <entry name="serial">e62931e3-90bb-4959-825c-e80dfc391989</entry>
Nov 13 20:44:04 user nova-compute[75239]:       <entry name="uuid">e62931e3-90bb-4959-825c-e80dfc391989</entry>
Nov 13 20:44:04 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:44:04 user nova-compute[75239]:     </system>
Nov 13 20:44:04 user nova-compute[75239]:   </sysinfo>
Nov 13 20:44:04 user nova-compute[75239]:   <os>
Nov 13 20:44:04 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:44:04 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:44:04 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:44:04 user nova-compute[75239]:   </os>
Nov 13 20:44:04 user nova-compute[75239]:   <features>
Nov 13 20:44:04 user nova-compute[75239]:     <acpi/>
Nov 13 20:44:04 user nova-compute[75239]:     <apic/>
Nov 13 20:44:04 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:44:04 user nova-compute[75239]:   </features>
Nov 13 20:44:04 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:44:04 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:44:04 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:44:04 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:44:04 user nova-compute[75239]:   </clock>
Nov 13 20:44:04 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:44:04 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:44:04 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:44:04 user nova-compute[75239]:   </cpu>
Nov 13 20:44:04 user nova-compute[75239]:   <devices>
Nov 13 20:44:04 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:44:04 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:44:04 user nova-compute[75239]:       <source dev="/dev/sde"/>
Nov 13 20:44:04 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:44:04 user nova-compute[75239]:       <serial>3a60d3dd-39ef-42d4-9c16-d13ccdea60c9</serial>
Nov 13 20:44:04 user nova-compute[75239]:     </disk>
Nov 13 20:44:04 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:44:04 user nova-compute[75239]:       <mac address="fa:16:3e:3f:04:f5"/>
Nov 13 20:44:04 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:44:04 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:44:04 user nova-compute[75239]:       <target dev="tapc81078b8-09"/>
Nov 13 20:44:04 user nova-compute[75239]:     </interface>
Nov 13 20:44:04 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:44:04 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/e62931e3-90bb-4959-825c-e80dfc391989/console.log" append="off"/>
Nov 13 20:44:04 user nova-compute[75239]:     </serial>
Nov 13 20:44:04 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:44:04 user nova-compute[75239]:     <video>
Nov 13 20:44:04 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:44:04 user nova-compute[75239]:     </video>
Nov 13 20:44:04 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:44:04 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:44:04 user nova-compute[75239]:     </rng>
Nov 13 20:44:04 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:44:04 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:44:04 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:44:04 user nova-compute[75239]:     </memballoon>
Nov 13 20:44:04 user nova-compute[75239]:   </devices>
Nov 13 20:44:04 user nova-compute[75239]: </domain>
Nov 13 20:44:04 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1277596519',display_name='tempest-ServerActionsTestOtherA-server-1277596519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1277596519',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx37q9vY0QYlo3fI5aFH9X6d2hNyPjTGXNNUmCr6ibGa/Kc1ClaPlhMidaIIsV7Y1igpikXwuCDpafpWPc5/9hzW0qq+/XK1xQPQ4kHZy5qMv84+zHN9XJn4hcGarD9Lw==',key_name='tempest-keypair-1127026760',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-qvsenhs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:43:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=e62931e3-90bb-4959-825c-e80dfc391989,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG os_vif [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd0c2aa5-21bc-5c68-8f7a-a3d388b383e1', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc81078b8-09, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc81078b8-09, col_values=(('qos', UUID('2b937af3-a81e-4c94-ad57-ee0a34911e41')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc81078b8-09, col_values=(('external_ids', {'iface-id': 'c81078b8-09c9-413f-8166-acd8fa285a00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:04:f5', 'vm-uuid': 'e62931e3-90bb-4959-825c-e80dfc391989'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:04 user nova-compute[75239]: INFO os_vif [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09')
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:44:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No VIF found with MAC fa:16:3e:3f:04:f5, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-fc44296c-eca5-4dd4-96c8-ed0020dcecd3 req-4f39612d-be75-4857-831e-ad6e869477a8 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fc44296c-eca5-4dd4-96c8-ed0020dcecd3 req-4f39612d-be75-4857-831e-ad6e869477a8 service nova] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fc44296c-eca5-4dd4-96c8-ed0020dcecd3 req-4f39612d-be75-4857-831e-ad6e869477a8 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fc44296c-eca5-4dd4-96c8-ed0020dcecd3 req-4f39612d-be75-4857-831e-ad6e869477a8 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-fc44296c-eca5-4dd4-96c8-ed0020dcecd3 req-4f39612d-be75-4857-831e-ad6e869477a8 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] No waiting events found dispatching network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:44:06 user nova-compute[75239]: WARNING nova.compute.manager [req-fc44296c-eca5-4dd4-96c8-ed0020dcecd3 req-4f39612d-be75-4857-831e-ad6e869477a8 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received unexpected event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 for instance with vm_state building and task_state spawning.
Nov 13 20:44:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-21c7bda4-a9cc-42d0-906b-092e2ae75619 req-8f514ce2-0c2c-44b1-8bdb-3faca450170f service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received event network-changed-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-21c7bda4-a9cc-42d0-906b-092e2ae75619 req-8f514ce2-0c2c-44b1-8bdb-3faca450170f service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Refreshing instance network info cache due to event network-changed-3a120adc-128c-4dba-aab5-c23fd9ee017d. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21c7bda4-a9cc-42d0-906b-092e2ae75619 req-8f514ce2-0c2c-44b1-8bdb-3faca450170f service nova] Acquiring lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21c7bda4-a9cc-42d0-906b-092e2ae75619 req-8f514ce2-0c2c-44b1-8bdb-3faca450170f service nova] Acquired lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-21c7bda4-a9cc-42d0-906b-092e2ae75619 req-8f514ce2-0c2c-44b1-8bdb-3faca450170f service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Refreshing network info cache for port 3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:07 user nova-compute[75239]: INFO nova.compute.manager [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Terminating instance
Nov 13 20:44:07 user nova-compute[75239]: DEBUG nova.compute.manager [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:07 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:44:07 user nova-compute[75239]: INFO nova.compute.claims [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Claim successful on node user
Nov 13 20:44:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.network.neutron [req-21c7bda4-a9cc-42d0-906b-092e2ae75619 req-8f514ce2-0c2c-44b1-8bdb-3faca450170f service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Updated VIF entry in instance network info cache for port 3a120adc-128c-4dba-aab5-c23fd9ee017d. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.network.neutron [req-21c7bda4-a9cc-42d0-906b-092e2ae75619 req-8f514ce2-0c2c-44b1-8bdb-3faca450170f service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Updating instance_info_cache with network_info: [{"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-21c7bda4-a9cc-42d0-906b-092e2ae75619 req-8f514ce2-0c2c-44b1-8bdb-3faca450170f service nova] Releasing lock "refresh_cache-1ec27628-db61-49c0-951b-6e72ac2f4f15" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Instance destroyed successfully.
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.objects.instance [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lazy-loading 'resources' on Instance uuid 1ec27628-db61-49c0-951b-6e72ac2f4f15 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:37:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1722150779',display_name='tempest-TestStampPattern-server-1722150779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1722150779',id=19,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsJkUh8tzjbwjGz2z/FPh6VoEoc5eNHl/mHpg0AYJPwTCL8t4LK5SGwpvdKX8mICr9zRERa/UEuI0kQJy2b6EW0qfB+fmIFb5tJy6989x+nGNRdNksl6VWF1E+4Wj6iBQ==',key_name='tempest-TestStampPattern-1567089186',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:37:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d292feb205994cddb6f2765da53fee90',ramdisk_id='',reservation_id='r-vl30rnjx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1429319310',owner_user_name='tempest-TestStampPattern-1429319310-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:40:20Z,user_data=None,user_id='297728d5d4c4454a9f9acd594d24b232',uuid=1ec27628-db61-49c0-951b-6e72ac2f4f15,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converting VIF {"id": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "address": "fa:16:3e:b8:03:ba", "network": {"id": "cdd53762-ff1f-4c6c-9ed4-7b03bef33892", "bridge": "br-int", "label": "tempest-TestStampPattern-1204574008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d292feb205994cddb6f2765da53fee90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a120adc-12", "ovs_interfaceid": "3a120adc-128c-4dba-aab5-c23fd9ee017d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:03:ba,bridge_name='br-int',has_traffic_filtering=True,id=3a120adc-128c-4dba-aab5-c23fd9ee017d,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a120adc-12') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG os_vif [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:03:ba,bridge_name='br-int',has_traffic_filtering=True,id=3a120adc-128c-4dba-aab5-c23fd9ee017d,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a120adc-12') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a120adc-12, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59348b24-8455-4fae-a73d-891ddf67de8c) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:08 user nova-compute[75239]: INFO os_vif [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:03:ba,bridge_name='br-int',has_traffic_filtering=True,id=3a120adc-128c-4dba-aab5-c23fd9ee017d,network=Network(cdd53762-ff1f-4c6c-9ed4-7b03bef33892),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a120adc-12')
Nov 13 20:44:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Deleting instance files /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15_del
Nov 13 20:44:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Deletion of /opt/stack/data/nova/instances/1ec27628-db61-49c0-951b-6e72ac2f4f15_del complete
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:44:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Instance spawned successfully.
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:44:08 user nova-compute[75239]: INFO nova.compute.manager [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 13 20:44:08 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-f4429b9e-1ba3-404f-8126-785aa4953188 req-af2e86f7-234d-4947-8070-bced5c63a578 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f4429b9e-1ba3-404f-8126-785aa4953188 req-af2e86f7-234d-4947-8070-bced5c63a578 service nova] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f4429b9e-1ba3-404f-8126-785aa4953188 req-af2e86f7-234d-4947-8070-bced5c63a578 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f4429b9e-1ba3-404f-8126-785aa4953188 req-af2e86f7-234d-4947-8070-bced5c63a578 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-f4429b9e-1ba3-404f-8126-785aa4953188 req-af2e86f7-234d-4947-8070-bced5c63a578 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] No waiting events found dispatching network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:44:08 user nova-compute[75239]: WARNING nova.compute.manager [req-f4429b9e-1ba3-404f-8126-785aa4953188 req-af2e86f7-234d-4947-8070-bced5c63a578 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received unexpected event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 for instance with vm_state building and task_state spawning.
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:44:08 user nova-compute[75239]: INFO nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:44:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:44:08 user nova-compute[75239]: INFO nova.virt.block_device [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Booting with volume-backed-image 800ade11-c0e2-452c-9cf5-70051593ac8f at /dev/vda
Nov 13 20:44:08 user nova-compute[75239]: INFO nova.compute.manager [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Took 10.40 seconds to build instance.
Nov 13 20:44:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8aec7023-3c17-4504-b335-cc1ed07d50a7 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.513s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:08 user nova-compute[75239]: DEBUG nova.policy [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2669d647fe6f4034bc70703546345eb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f465510aec2849dfb0917120a772f066', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:09 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Took 0.71 seconds to deallocate network for instance.
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Successfully created port: 26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received event network-vif-unplugged-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] No waiting events found dispatching network-vif-unplugged-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:44:09 user nova-compute[75239]: WARNING nova.compute.manager [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received unexpected event network-vif-unplugged-3a120adc-128c-4dba-aab5-c23fd9ee017d for instance with vm_state deleted and task_state None.
Nov 13 20:44:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received event network-vif-plugged-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] Acquiring lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] No waiting events found dispatching network-vif-plugged-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:44:09 user nova-compute[75239]: WARNING nova.compute.manager [req-cf505da3-e694-484b-9288-68278ecd5828 req-2c54a8be-d0ca-4510-8f3d-2dfa800128e5 service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received unexpected event network-vif-plugged-3a120adc-128c-4dba-aab5-c23fd9ee017d for instance with vm_state deleted and task_state None.
Nov 13 20:44:09 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:09 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Deleted allocations for instance 1ec27628-db61-49c0-951b-6e72ac2f4f15
Nov 13 20:44:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-892c3552-753c-4fba-bd74-b19252335693 tempest-TestStampPattern-1429319310 tempest-TestStampPattern-1429319310-project-member] Lock "1ec27628-db61-49c0-951b-6e72ac2f4f15" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.409s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Successfully updated port: 26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquired lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Updating instance_info_cache with network_info: [{"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Releasing lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Instance network_info: |[{"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-69b5880d-847f-4e01-9f01-5feb159487cd req-b7b6e2fa-18b1-4523-a2cd-2e8bd52ffaaa service nova] [instance: 1ec27628-db61-49c0-951b-6e72ac2f4f15] Received event network-vif-deleted-3a120adc-128c-4dba-aab5-c23fd9ee017d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-69b5880d-847f-4e01-9f01-5feb159487cd req-b7b6e2fa-18b1-4523-a2cd-2e8bd52ffaaa service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-changed-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-69b5880d-847f-4e01-9f01-5feb159487cd req-b7b6e2fa-18b1-4523-a2cd-2e8bd52ffaaa service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Refreshing instance network info cache due to event network-changed-26feda94-26fa-4eda-b66a-0d3402158d5b. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69b5880d-847f-4e01-9f01-5feb159487cd req-b7b6e2fa-18b1-4523-a2cd-2e8bd52ffaaa service nova] Acquiring lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69b5880d-847f-4e01-9f01-5feb159487cd req-b7b6e2fa-18b1-4523-a2cd-2e8bd52ffaaa service nova] Acquired lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:10 user nova-compute[75239]: DEBUG nova.network.neutron [req-69b5880d-847f-4e01-9f01-5feb159487cd req-b7b6e2fa-18b1-4523-a2cd-2e8bd52ffaaa service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Refreshing network info cache for port 26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:44:11 user nova-compute[75239]: DEBUG nova.network.neutron [req-69b5880d-847f-4e01-9f01-5feb159487cd req-b7b6e2fa-18b1-4523-a2cd-2e8bd52ffaaa service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Updated VIF entry in instance network info cache for port 26feda94-26fa-4eda-b66a-0d3402158d5b. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:44:11 user nova-compute[75239]: DEBUG nova.network.neutron [req-69b5880d-847f-4e01-9f01-5feb159487cd req-b7b6e2fa-18b1-4523-a2cd-2e8bd52ffaaa service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Updating instance_info_cache with network_info: [{"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69b5880d-847f-4e01-9f01-5feb159487cd req-b7b6e2fa-18b1-4523-a2cd-2e8bd52ffaaa service nova] Releasing lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG os_brick.utils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc3acf7-a14e-445b-ac50-aa0da3808afc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c1dd4d-fe89-4779-a1fb-96d1009fd3f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b7a498-72d9-4c38-af55-89bbd84eae74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c47a4a2-5f84-49aa-b609-f6c1d7522094]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:44:14 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:44:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32d21a2-af7e-48b8-a8f6-09584f6c1d21]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG os_brick.utils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:44:14 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Updating existing volume attachment record: f7fe4868-00ae-45da-9ce2-11ef762cfd58 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:44:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:44:18 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Creating image(s)
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Ensure instance console log exists: /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Start _get_guest_xml network_info=[{"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f7fe4868-00ae-45da-9ce2-11ef762cfd58', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxrEQtas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ba53275-7df4-4ecf-a4cc-860975b83d5f', 'attached_at': '', 'detached_at': '', 'volume_id': '78bb4404-70be-4898-aae4-a63902fa601d', 'serial': '78bb4404-70be-4898-aae4-a63902fa601d'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:44:18 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:44:18 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxrEQtas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:44:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:44:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:44:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:44:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:44:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:44:18 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccfec96-58bf-4e26-94ff-90beadf49cf9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:44:19 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1291c676-8570-4c93-b189-8341ceee6e38]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d] added
Nov 13 20:44:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1055a39-42a0-4593-9932-78b2849e5059]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4986b1-bca8-428d-8e34-812304d0ade7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxrEQtas {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxrEQtas" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8161f68b-eb48-405a-a77d-d55a506dbd51]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SxrEQtas'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[251962a0-daf8-48a6-9fd2-8782870f11b5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a75172-8462-4908-bd4c-6e624b4b6224]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e429b646-d36f-49f1-b34a-27930f403971]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d, portal: 172.16.0.220,3260]
Nov 13 20:44:19 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d, portal: 172.16.0.220,3260] successful.
Nov 13 20:44:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[327962a2-23cb-48d0-8a87-8f9071b08921]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c025878-1cf3-46e5-8d62-e3dcbbde8e7e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:44:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:19 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:44:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce12537c-0a53-4b8b-adbb-a433cd713bbe]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:44:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxrEQtas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23038396637643961', 'path': '/dev/sdf'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038396637643961', 'path': '/dev/sdf'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:44:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1592386908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1592386908',id=31,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-5jmj3d54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:44:09Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=0ba53275-7df4-4ecf-a4cc-860975b83d5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:2f:80,bridge_name='br-int',has_traffic_filtering=True,id=26feda94-26fa-4eda-b66a-0d3402158d5b,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26feda94-26') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:44:20 user nova-compute[75239]:   <uuid>0ba53275-7df4-4ecf-a4cc-860975b83d5f</uuid>
Nov 13 20:44:20 user nova-compute[75239]:   <name>instance-0000001f</name>
Nov 13 20:44:20 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:44:20 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:44:20 user nova-compute[75239]:   <metadata>
Nov 13 20:44:20 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:44:20 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:44:20 user nova-compute[75239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1592386908</nova:name>
Nov 13 20:44:20 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:44:18</nova:creationTime>
Nov 13 20:44:20 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:44:20 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:44:20 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:44:20 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:44:20 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:44:20 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:44:20 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:44:20 user nova-compute[75239]:       <nova:owner>
Nov 13 20:44:20 user nova-compute[75239]:         <nova:user uuid="2669d647fe6f4034bc70703546345eb3">tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member</nova:user>
Nov 13 20:44:20 user nova-compute[75239]:         <nova:project uuid="f465510aec2849dfb0917120a772f066">tempest-ServerBootFromVolumeStableRescueTest-2033691872</nova:project>
Nov 13 20:44:20 user nova-compute[75239]:       </nova:owner>
Nov 13 20:44:20 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:44:20 user nova-compute[75239]:       <nova:ports>
Nov 13 20:44:20 user nova-compute[75239]:         <nova:port uuid="26feda94-26fa-4eda-b66a-0d3402158d5b">
Nov 13 20:44:20 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 20:44:20 user nova-compute[75239]:         </nova:port>
Nov 13 20:44:20 user nova-compute[75239]:       </nova:ports>
Nov 13 20:44:20 user nova-compute[75239]:     </nova:instance>
Nov 13 20:44:20 user nova-compute[75239]:   </metadata>
Nov 13 20:44:20 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:44:20 user nova-compute[75239]:     <system>
Nov 13 20:44:20 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:44:20 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:44:20 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:44:20 user nova-compute[75239]:       <entry name="serial">0ba53275-7df4-4ecf-a4cc-860975b83d5f</entry>
Nov 13 20:44:20 user nova-compute[75239]:       <entry name="uuid">0ba53275-7df4-4ecf-a4cc-860975b83d5f</entry>
Nov 13 20:44:20 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:44:20 user nova-compute[75239]:     </system>
Nov 13 20:44:20 user nova-compute[75239]:   </sysinfo>
Nov 13 20:44:20 user nova-compute[75239]:   <os>
Nov 13 20:44:20 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:44:20 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:44:20 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:44:20 user nova-compute[75239]:   </os>
Nov 13 20:44:20 user nova-compute[75239]:   <features>
Nov 13 20:44:20 user nova-compute[75239]:     <acpi/>
Nov 13 20:44:20 user nova-compute[75239]:     <apic/>
Nov 13 20:44:20 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:44:20 user nova-compute[75239]:   </features>
Nov 13 20:44:20 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:44:20 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:44:20 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:44:20 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:44:20 user nova-compute[75239]:   </clock>
Nov 13 20:44:20 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:44:20 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:44:20 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:44:20 user nova-compute[75239]:   </cpu>
Nov 13 20:44:20 user nova-compute[75239]:   <devices>
Nov 13 20:44:20 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:44:20 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:44:20 user nova-compute[75239]:       <source dev="/dev/sdf"/>
Nov 13 20:44:20 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:44:20 user nova-compute[75239]:       <serial>78bb4404-70be-4898-aae4-a63902fa601d</serial>
Nov 13 20:44:20 user nova-compute[75239]:     </disk>
Nov 13 20:44:20 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:44:20 user nova-compute[75239]:       <mac address="fa:16:3e:86:2f:80"/>
Nov 13 20:44:20 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:44:20 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:44:20 user nova-compute[75239]:       <target dev="tap26feda94-26"/>
Nov 13 20:44:20 user nova-compute[75239]:     </interface>
Nov 13 20:44:20 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:44:20 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/console.log" append="off"/>
Nov 13 20:44:20 user nova-compute[75239]:     </serial>
Nov 13 20:44:20 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:44:20 user nova-compute[75239]:     <video>
Nov 13 20:44:20 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:44:20 user nova-compute[75239]:     </video>
Nov 13 20:44:20 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:44:20 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:44:20 user nova-compute[75239]:     </rng>
Nov 13 20:44:20 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:44:20 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:44:20 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:44:20 user nova-compute[75239]:     </memballoon>
Nov 13 20:44:20 user nova-compute[75239]:   </devices>
Nov 13 20:44:20 user nova-compute[75239]: </domain>
Nov 13 20:44:20 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:44:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1592386908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1592386908',id=31,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-5jmj3d54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:44:09Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=0ba53275-7df4-4ecf-a4cc-860975b83d5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:2f:80,bridge_name='br-int',has_traffic_filtering=True,id=26feda94-26fa-4eda-b66a-0d3402158d5b,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26feda94-26') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG os_vif [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:2f:80,bridge_name='br-int',has_traffic_filtering=True,id=26feda94-26fa-4eda-b66a-0d3402158d5b,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26feda94-26') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db833939-97a7-56c3-8c55-18dc778cc3a9', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26feda94-26, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26feda94-26, col_values=(('qos', UUID('f17d8f78-4aea-4688-8ab6-ca0456b2e1b4')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26feda94-26, col_values=(('external_ids', {'iface-id': '26feda94-26fa-4eda-b66a-0d3402158d5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:2f:80', 'vm-uuid': '0ba53275-7df4-4ecf-a4cc-860975b83d5f'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:20 user nova-compute[75239]: INFO os_vif [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:2f:80,bridge_name='br-int',has_traffic_filtering=True,id=26feda94-26fa-4eda-b66a-0d3402158d5b,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26feda94-26')
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:44:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No VIF found with MAC fa:16:3e:86:2f:80, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:44:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ba0f103-46e4-473b-85ec-32cfdc5b0064 req-12ef0707-1b35-4b32-a559-a4a415b17387 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ba0f103-46e4-473b-85ec-32cfdc5b0064 req-12ef0707-1b35-4b32-a559-a4a415b17387 service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ba0f103-46e4-473b-85ec-32cfdc5b0064 req-12ef0707-1b35-4b32-a559-a4a415b17387 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ba0f103-46e4-473b-85ec-32cfdc5b0064 req-12ef0707-1b35-4b32-a559-a4a415b17387 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ba0f103-46e4-473b-85ec-32cfdc5b0064 req-12ef0707-1b35-4b32-a559-a4a415b17387 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:44:22 user nova-compute[75239]: WARNING nova.compute.manager [req-8ba0f103-46e4-473b-85ec-32cfdc5b0064 req-12ef0707-1b35-4b32-a559-a4a415b17387 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state building and task_state spawning.
Nov 13 20:44:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:44:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:44:23 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Instance spawned successfully.
Nov 13 20:44:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:44:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:44:24 user nova-compute[75239]: INFO nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 13 20:44:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:44:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-fe31ed87-9d45-4dba-9017-269aca5477e2 req-6de89f42-85e6-43d9-97d3-377e12138d4d service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe31ed87-9d45-4dba-9017-269aca5477e2 req-6de89f42-85e6-43d9-97d3-377e12138d4d service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe31ed87-9d45-4dba-9017-269aca5477e2 req-6de89f42-85e6-43d9-97d3-377e12138d4d service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe31ed87-9d45-4dba-9017-269aca5477e2 req-6de89f42-85e6-43d9-97d3-377e12138d4d service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-fe31ed87-9d45-4dba-9017-269aca5477e2 req-6de89f42-85e6-43d9-97d3-377e12138d4d service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:44:24 user nova-compute[75239]: WARNING nova.compute.manager [req-fe31ed87-9d45-4dba-9017-269aca5477e2 req-6de89f42-85e6-43d9-97d3-377e12138d4d service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state building and task_state spawning.
Nov 13 20:44:24 user nova-compute[75239]: INFO nova.compute.manager [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Took 16.36 seconds to build instance.
Nov 13 20:44:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d46bc992-a6cc-404b-b679-13c2b038a300 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.476s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:44:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:35 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:44:35 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:44:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7024MB free_disk=24.782825469970703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:44:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Applying migration context for instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 as it has an incoming, in-progress migration a3295796-2e28-4571-be82-dd0701892400. Migration status is finished {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 20:44:35 user nova-compute[75239]: INFO nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating resource usage from migration a3295796-2e28-4571-be82-dd0701892400
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance b24f2bf2-0c75-49c3-acce-c811f5454d8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 7525c321-c164-4d14-8364-23f07eb826b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 40d7bf6c-7117-431d-9223-8b7068f58d4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Migration a3295796-2e28-4571-be82-dd0701892400 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e62931e3-90bb-4959-825c-e80dfc391989 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 0ba53275-7df4-4ecf-a4cc-860975b83d5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:44:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.564s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:44:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-7ea49814-9f1e-40ed-85ec-ab8bff47ea2e req-5cfdcfc8-cc08-46c0-8cb7-1c5d73ec9388 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received event network-changed-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-7ea49814-9f1e-40ed-85ec-ab8bff47ea2e req-5cfdcfc8-cc08-46c0-8cb7-1c5d73ec9388 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Refreshing instance network info cache due to event network-changed-3f327526-3f38-4901-b271-8e38739d7b59. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:44:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7ea49814-9f1e-40ed-85ec-ab8bff47ea2e req-5cfdcfc8-cc08-46c0-8cb7-1c5d73ec9388 service nova] Acquiring lock "refresh_cache-b24f2bf2-0c75-49c3-acce-c811f5454d8d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7ea49814-9f1e-40ed-85ec-ab8bff47ea2e req-5cfdcfc8-cc08-46c0-8cb7-1c5d73ec9388 service nova] Acquired lock "refresh_cache-b24f2bf2-0c75-49c3-acce-c811f5454d8d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:39 user nova-compute[75239]: DEBUG nova.network.neutron [req-7ea49814-9f1e-40ed-85ec-ab8bff47ea2e req-5cfdcfc8-cc08-46c0-8cb7-1c5d73ec9388 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Refreshing network info cache for port 3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:44:39 user nova-compute[75239]: DEBUG nova.network.neutron [req-7ea49814-9f1e-40ed-85ec-ab8bff47ea2e req-5cfdcfc8-cc08-46c0-8cb7-1c5d73ec9388 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Updated VIF entry in instance network info cache for port 3f327526-3f38-4901-b271-8e38739d7b59. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:44:39 user nova-compute[75239]: DEBUG nova.network.neutron [req-7ea49814-9f1e-40ed-85ec-ab8bff47ea2e req-5cfdcfc8-cc08-46c0-8cb7-1c5d73ec9388 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Updating instance_info_cache with network_info: [{"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7ea49814-9f1e-40ed-85ec-ab8bff47ea2e req-5cfdcfc8-cc08-46c0-8cb7-1c5d73ec9388 service nova] Releasing lock "refresh_cache-b24f2bf2-0c75-49c3-acce-c811f5454d8d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:44:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:44:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updating instance_info_cache with network_info: [{"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lazy-loading 'flavor' on Instance uuid b24f2bf2-0c75-49c3-acce-c811f5454d8d {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:42 user nova-compute[75239]: INFO nova.compute.manager [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Attaching volume cfd4bac1-c584-4053-9a9d-c92c0dca8dec to /dev/vdb
Nov 13 20:44:42 user nova-compute[75239]: DEBUG os_brick.utils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b983ad-a4ac-44fe-b93d-d4a9ccc204cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[480f77c7-9b1d-456f-a384-a9180a949c6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f0fda1-c48b-4831-946b-7fdf77d5342c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce91a106-bb38-4a1f-8eb0-b20882a037c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:44:42 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:44:42 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e7dcdf-191d-48b3-a97a-eedede6705dc]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG os_brick.utils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Updating existing volume attachment record: ab9d941c-4459-4948-9954-66f8fb75a573 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:44:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYPwFHva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:44:46 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:44:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:44:46 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:44:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:44:46 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb3f864-1bd6-4e92-a48c-937fa4ac19db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:44:46 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[978d0232-ebad-4db6-b0ec-6deb1a595992]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec] added
Nov 13 20:44:46 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d626c60-51a3-46f8-a4ce-bfe0fae6d099]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6ad33c-0f30-4f5f-8481-06a22e5bdc85]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYPwFHva {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYPwFHva" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb5035-8b96-451d-add0-b5947ab200ff]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYPwFHva'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9475c3-003b-4769-9bb4-bf48de5d4e79]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e73c81-5352-481e-93b3-f2f86a1dd740]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:44:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:44:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0872217-fa95-4cf9-8859-89c5a8fd5389]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec, portal: 172.16.0.220,3260]
Nov 13 20:44:47 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec, portal: 172.16.0.220,3260] successful.
Nov 13 20:44:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8529bb-d44e-46cb-bd0e-2b8ec019c87f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e33e21a-ff90-48e8-9d54-b150989e77fe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec (non-flash)
Nov 13 20:44:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:44:47 user nova-compute[75239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec (non-flash)
Nov 13 20:44:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4d3688-145c-473e-b925-c8cba26a85bf]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYPwFHva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-f0534919-7a59-456f-bb5f-ad39c488db27 req-23418cc7-8031-4ed4-a627-aa2fc8abdecf service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-changed-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-f0534919-7a59-456f-bb5f-ad39c488db27 req-23418cc7-8031-4ed4-a627-aa2fc8abdecf service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Refreshing instance network info cache due to event network-changed-0be4f3e6-716b-4a52-b027-5a84d8415292. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f0534919-7a59-456f-bb5f-ad39c488db27 req-23418cc7-8031-4ed4-a627-aa2fc8abdecf service nova] Acquiring lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f0534919-7a59-456f-bb5f-ad39c488db27 req-23418cc7-8031-4ed4-a627-aa2fc8abdecf service nova] Acquired lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-f0534919-7a59-456f-bb5f-ad39c488db27 req-23418cc7-8031-4ed4-a627-aa2fc8abdecf service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Refreshing network info cache for port 0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:44:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-f0534919-7a59-456f-bb5f-ad39c488db27 req-23418cc7-8031-4ed4-a627-aa2fc8abdecf service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updated VIF entry in instance network info cache for port 0be4f3e6-716b-4a52-b027-5a84d8415292. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-f0534919-7a59-456f-bb5f-ad39c488db27 req-23418cc7-8031-4ed4-a627-aa2fc8abdecf service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating instance_info_cache with network_info: [{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f0534919-7a59-456f-bb5f-ad39c488db27 req-23418cc7-8031-4ed4-a627-aa2fc8abdecf service nova] Releasing lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23737306237343366', 'path': '/dev/sdg'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737306237343366', 'path': '/dev/sdg'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lazy-loading 'flavor' on Instance uuid b24f2bf2-0c75-49c3-acce-c811f5454d8d {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:44:48 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:44:48 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:44:48 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:44:48 user nova-compute[75239]:   <serial>cfd4bac1-c584-4053-9a9d-c92c0dca8dec</serial>
Nov 13 20:44:48 user nova-compute[75239]: </disk>
Nov 13 20:44:48 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] No VIF found with MAC fa:16:3e:0b:da:ce, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:44:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a2cf8c38-450d-428d-bb54-5dcd11252015 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.157s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:50 user nova-compute[75239]: INFO nova.compute.manager [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Shelving
Nov 13 20:44:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:50 user nova-compute[75239]: INFO nova.compute.manager [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Detaching volume cfd4bac1-c584-4053-9a9d-c92c0dca8dec
Nov 13 20:44:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:50 user nova-compute[75239]: INFO nova.virt.block_device [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Attempting to driver detach volume cfd4bac1-c584-4053-9a9d-c92c0dca8dec from mountpoint /dev/vdb
Nov 13 20:44:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Attempting to detach device vdb from instance b24f2bf2-0c75-49c3-acce-c811f5454d8d from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:44:50 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:44:50 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:44:50 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:44:50 user nova-compute[75239]:   <serial>cfd4bac1-c584-4053-9a9d-c92c0dca8dec</serial>
Nov 13 20:44:50 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:44:50 user nova-compute[75239]: </disk>
Nov 13 20:44:50 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:44:50 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Successfully detached device vdb from instance b24f2bf2-0c75-49c3-acce-c811f5454d8d from the persistent domain config.
Nov 13 20:44:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b24f2bf2-0c75-49c3-acce-c811f5454d8d from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:44:50 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:44:50 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:44:50 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:44:50 user nova-compute[75239]:   <serial>cfd4bac1-c584-4053-9a9d-c92c0dca8dec</serial>
Nov 13 20:44:50 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:44:50 user nova-compute[75239]: </disk>
Nov 13 20:44:50 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-ec268375-5641-4f1f-b8e2-f29488b475b2 req-422eb447-30b7-4300-8d76-30e04c09780b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-unplugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ec268375-5641-4f1f-b8e2-f29488b475b2 req-422eb447-30b7-4300-8d76-30e04c09780b service nova] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ec268375-5641-4f1f-b8e2-f29488b475b2 req-422eb447-30b7-4300-8d76-30e04c09780b service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ec268375-5641-4f1f-b8e2-f29488b475b2 req-422eb447-30b7-4300-8d76-30e04c09780b service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-ec268375-5641-4f1f-b8e2-f29488b475b2 req-422eb447-30b7-4300-8d76-30e04c09780b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] No waiting events found dispatching network-vif-unplugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:44:50 user nova-compute[75239]: WARNING nova.compute.manager [req-ec268375-5641-4f1f-b8e2-f29488b475b2 req-422eb447-30b7-4300-8d76-30e04c09780b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received unexpected event network-vif-unplugged-0be4f3e6-716b-4a52-b027-5a84d8415292 for instance with vm_state active and task_state shelving.
Nov 13 20:44:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b24f2bf2-0c75-49c3-acce-c811f5454d8d {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:44:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance destroyed successfully.
Nov 13 20:44:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Beginning cold snapshot process
Nov 13 20:44:51 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:44:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk /opt/stack/data/nova/instances/snapshots/tmp0kqp8x6e/1532a6e6b9ca44f9b24c96f65367d116 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:44:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk /opt/stack/data/nova/instances/snapshots/tmp0kqp8x6e/1532a6e6b9ca44f9b24c96f65367d116" returned: 0 in 0.731s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:44:52 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Snapshot extracted, beginning image upload
Nov 13 20:44:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-6470a227-4e7f-4c02-a508-e79ac0e961a5 req-50b3aaf9-2fc4-4c2a-a683-4846cbdf485d service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6470a227-4e7f-4c02-a508-e79ac0e961a5 req-50b3aaf9-2fc4-4c2a-a683-4846cbdf485d service nova] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6470a227-4e7f-4c02-a508-e79ac0e961a5 req-50b3aaf9-2fc4-4c2a-a683-4846cbdf485d service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6470a227-4e7f-4c02-a508-e79ac0e961a5 req-50b3aaf9-2fc4-4c2a-a683-4846cbdf485d service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-6470a227-4e7f-4c02-a508-e79ac0e961a5 req-50b3aaf9-2fc4-4c2a-a683-4846cbdf485d service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] No waiting events found dispatching network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:44:52 user nova-compute[75239]: WARNING nova.compute.manager [req-6470a227-4e7f-4c02-a508-e79ac0e961a5 req-50b3aaf9-2fc4-4c2a-a683-4846cbdf485d service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received unexpected event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 20:44:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:54 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Snapshot image upload complete
Nov 13 20:44:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:44:54 user nova-compute[75239]: INFO nova.compute.manager [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Shelve offloading
Nov 13 20:44:54 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance destroyed successfully.
Nov 13 20:44:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquired lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating instance_info_cache with network_info: [{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Releasing lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:55 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance destroyed successfully.
Nov 13 20:44:55 user nova-compute[75239]: DEBUG nova.objects.instance [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'resources' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1053010473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1053010473',id=28,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1MUOZJC1PwkWhvuRjvIe4l97M8X+mJObuO0KnCNwUZy+BooepOOUP+DTeLCizOjuaf8v86GPelp+OBYk6AdkhvEu/Ve/cqycjHiSR/O3kYCZ3UNQiwFXuMbBvSW/oGWQ==',key_name='tempest-keypair-452032804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:43:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-fffww73p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member',shelved_at='2023-11-13T20:44:54.878880',shelved_host='user',shelved_image_id='478e466f-f7cc-4126-a94e-8e3673980846'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:44:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=7525c321-c164-4d14-8364-23f07eb826b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG os_vif [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0be4f3e6-71, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cca2e12-6553-44c5-b7de-23c3fff6a5f7) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-0ddc5917-c49c-4a75-b021-b49125343a71 req-19825501-7460-4a1c-aa6e-5c6caf980b1e service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-changed-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-0ddc5917-c49c-4a75-b021-b49125343a71 req-19825501-7460-4a1c-aa6e-5c6caf980b1e service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Refreshing instance network info cache due to event network-changed-0be4f3e6-716b-4a52-b027-5a84d8415292. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0ddc5917-c49c-4a75-b021-b49125343a71 req-19825501-7460-4a1c-aa6e-5c6caf980b1e service nova] Acquiring lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0ddc5917-c49c-4a75-b021-b49125343a71 req-19825501-7460-4a1c-aa6e-5c6caf980b1e service nova] Acquired lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG nova.network.neutron [req-0ddc5917-c49c-4a75-b021-b49125343a71 req-19825501-7460-4a1c-aa6e-5c6caf980b1e service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Refreshing network info cache for port 0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:44:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:44:55 user nova-compute[75239]: INFO os_vif [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71')
Nov 13 20:44:55 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Deleting instance files /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6_del
Nov 13 20:44:55 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Deletion of /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6_del complete
Nov 13 20:44:56 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Deleted allocations for instance 7525c321-c164-4d14-8364-23f07eb826b6
Nov 13 20:44:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG nova.objects.instance [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'numa_topology' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG nova.objects.base [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<7525c321-c164-4d14-8364-23f07eb826b6> lazy-loaded attributes: resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG nova.network.neutron [req-0ddc5917-c49c-4a75-b021-b49125343a71 req-19825501-7460-4a1c-aa6e-5c6caf980b1e service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updated VIF entry in instance network info cache for port 0be4f3e6-716b-4a52-b027-5a84d8415292. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG nova.network.neutron [req-0ddc5917-c49c-4a75-b021-b49125343a71 req-19825501-7460-4a1c-aa6e-5c6caf980b1e service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating instance_info_cache with network_info: [{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0ddc5917-c49c-4a75-b021-b49125343a71 req-19825501-7460-4a1c-aa6e-5c6caf980b1e service nova] Releasing lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-95a8c8d6-ecc9-4b4e-9658-1ada8c8c07a8 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.132s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:44:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-dcfd3e21-87a7-4c9e-8060-498614c69bed req-75cc7dd8-7164-43ed-b23d-3b7960f079ce service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-changed-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-dcfd3e21-87a7-4c9e-8060-498614c69bed req-75cc7dd8-7164-43ed-b23d-3b7960f079ce service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Refreshing instance network info cache due to event network-changed-dae63bc6-ac2b-45d5-a433-c8135bac7740. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dcfd3e21-87a7-4c9e-8060-498614c69bed req-75cc7dd8-7164-43ed-b23d-3b7960f079ce service nova] Acquiring lock "refresh_cache-40d7bf6c-7117-431d-9223-8b7068f58d4e" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dcfd3e21-87a7-4c9e-8060-498614c69bed req-75cc7dd8-7164-43ed-b23d-3b7960f079ce service nova] Acquired lock "refresh_cache-40d7bf6c-7117-431d-9223-8b7068f58d4e" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-dcfd3e21-87a7-4c9e-8060-498614c69bed req-75cc7dd8-7164-43ed-b23d-3b7960f079ce service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Refreshing network info cache for port dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-dcfd3e21-87a7-4c9e-8060-498614c69bed req-75cc7dd8-7164-43ed-b23d-3b7960f079ce service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Updated VIF entry in instance network info cache for port dae63bc6-ac2b-45d5-a433-c8135bac7740. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-dcfd3e21-87a7-4c9e-8060-498614c69bed req-75cc7dd8-7164-43ed-b23d-3b7960f079ce service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Updating instance_info_cache with network_info: [{"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dcfd3e21-87a7-4c9e-8060-498614c69bed req-75cc7dd8-7164-43ed-b23d-3b7960f079ce service nova] Releasing lock "refresh_cache-40d7bf6c-7117-431d-9223-8b7068f58d4e" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:08 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:09 user nova-compute[75239]: INFO nova.compute.manager [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Attaching volume ba1c8074-56da-4c04-b8dc-27016331f7db to /dev/vdb
Nov 13 20:45:09 user nova-compute[75239]: DEBUG os_brick.utils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b280c93-69bb-4ee1-b42a-8850ef42fc6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[715e5475-4d63-4a3d-8734-51362da6867d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caf9416-6e20-426e-b3ad-2fa20c48dade]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6894381b-cb35-4535-bafd-2253558af01a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:09 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:45:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7302e278-a57d-4e5f-9cb7-3ce6a6f687f3]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG os_brick.utils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:09 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Updating existing volume attachment record: e03739a0-93b3-4312-a8bb-d92f031b8258 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:45:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:11 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b24f2bf2-0c75-49c3-acce-c811f5454d8d is timed out.
Nov 13 20:45:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Successfully detached device vdb from instance b24f2bf2-0c75-49c3-acce-c811f5454d8d from the live domain config.
Nov 13 20:45:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYPwFHva', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:11 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6556d6d0-642b-4f65-865e-367dda888c27]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:45:11 user nova-compute[75239]: No targets found.
Nov 13 20:45:11 user nova-compute[75239]: iSNS:
Nov 13 20:45:11 user nova-compute[75239]: No targets found.
Nov 13 20:45:11 user nova-compute[75239]: STATIC:
Nov 13 20:45:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:45:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec
Nov 13 20:45:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca
Nov 13 20:45:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:45:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:45:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b
Nov 13 20:45:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:11 user nova-compute[75239]: FIRMWARE:
Nov 13 20:45:11 user nova-compute[75239]: No targets found.
Nov 13 20:45:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:45:11 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:45:11 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd5a884-0992-411d-9a00-9022e984c4ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf7668a-406b-4bc7-9298-48180ceeeb7d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec (non-flash)
Nov 13 20:45:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:11 user nova-compute[75239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec (non-flash)
Nov 13 20:45:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d6050f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec'): ({'sdg'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Removing single pathed devices sdg {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[52174ac6-60a1-48e2-b5fe-8682553b23f6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fae4e8a-5941-4ee9-9d4d-62d57989bb63]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Flushing IO for device /dev/sdg {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[200cb7d8-20b7-43f6-90fc-b06a58eb756b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f28174-9d33-4152-93df-f34e5ede89df]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6adf8b-028d-4d92-9c43-ca09646a76a1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc6d15-c4eb-44a9-acd9-3e8998a90dbe]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec, portal: 172.16.0.220,3260]
Nov 13 20:45:11 user nova-compute[75239]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cfd4bac1-c584-4053-9a9d-c92c0dca8dec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7591e406-9347-4b87-ba56-ec6ccfa83e1e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] <== disconnect_volume: return (345ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:45:12 user nova-compute[75239]: DEBUG nova.objects.instance [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lazy-loading 'flavor' on Instance uuid b24f2bf2-0c75-49c3-acce-c811f5454d8d {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-590012e4-624f-4bae-954f-dec21a6ce005 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.784s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:45:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:12 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:45:12 user nova-compute[75239]: INFO nova.compute.claims [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Claim successful on node user
Nov 13 20:45:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-6d3fd464-d4e0-439e-a270-902bedaeec9e req-ad5936b0-8b83-4c1d-b151-3747c0a477c8 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-6d3fd464-d4e0-439e-a270-902bedaeec9e req-ad5936b0-8b83-4c1d-b151-3747c0a477c8 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing instance network info cache due to event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6d3fd464-d4e0-439e-a270-902bedaeec9e req-ad5936b0-8b83-4c1d-b151-3747c0a477c8 service nova] Acquiring lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6d3fd464-d4e0-439e-a270-902bedaeec9e req-ad5936b0-8b83-4c1d-b151-3747c0a477c8 service nova] Acquired lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.network.neutron [req-6d3fd464-d4e0-439e-a270-902bedaeec9e req-ad5936b0-8b83-4c1d-b151-3747c0a477c8 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.network.neutron [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:45:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.policy [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b27083a4000d4ba2832a394b9140b530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41532512e3494bfd9051c340c2557bfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:45:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Creating image(s)
Nov 13 20:45:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.238s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-e7f49d05-95c9-46d9-95ef-9741da2e3bf2 req-88ae923f-2af1-4ddb-8468-af4248025043 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-e7f49d05-95c9-46d9-95ef-9741da2e3bf2 req-88ae923f-2af1-4ddb-8468-af4248025043 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing instance network info cache due to event network-changed-f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e7f49d05-95c9-46d9-95ef-9741da2e3bf2 req-88ae923f-2af1-4ddb-8468-af4248025043 service nova] Acquiring lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.203s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.network.neutron [req-6d3fd464-d4e0-439e-a270-902bedaeec9e req-ad5936b0-8b83-4c1d-b151-3747c0a477c8 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updated VIF entry in instance network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.network.neutron [req-6d3fd464-d4e0-439e-a270-902bedaeec9e req-ad5936b0-8b83-4c1d-b151-3747c0a477c8 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating instance_info_cache with network_info: [{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6d3fd464-d4e0-439e-a270-902bedaeec9e req-ad5936b0-8b83-4c1d-b151-3747c0a477c8 service nova] Releasing lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e7f49d05-95c9-46d9-95ef-9741da2e3bf2 req-88ae923f-2af1-4ddb-8468-af4248025043 service nova] Acquired lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.network.neutron [req-e7f49d05-95c9-46d9-95ef-9741da2e3bf2 req-88ae923f-2af1-4ddb-8468-af4248025043 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Refreshing network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk 1073741824" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.393s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:14 user nova-compute[75239]: INFO nova.compute.manager [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Detaching volume 07264292-6803-485b-b4cf-8972a13855ca
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmjtfNZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:14 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:14 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:14 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Cannot resize image /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Ensure instance console log exists: /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c4dea-14b0-472f-a342-25e5dd272e0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:45:14 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf44a32a-2849-4f85-a833-354eb9c8f7d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db] added
Nov 13 20:45:14 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: INFO nova.virt.block_device [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Attempting to driver detach volume 07264292-6803-485b-b4cf-8972a13855ca from mountpoint /dev/vdb
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Attempting to detach device vdb from instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:45:14 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:14 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:45:14 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:45:14 user nova-compute[75239]:   <serial>07264292-6803-485b-b4cf-8972a13855ca</serial>
Nov 13 20:45:14 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 20:45:14 user nova-compute[75239]: </disk>
Nov 13 20:45:14 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[456a0525-aac7-4aac-b299-f7531c040404]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully detached device vdb from instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 from the persistent domain config.
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:45:14 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:14 user nova-compute[75239]:   <source dev="/dev/sdd"/>
Nov 13 20:45:14 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:45:14 user nova-compute[75239]:   <serial>07264292-6803-485b-b4cf-8972a13855ca</serial>
Nov 13 20:45:14 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 20:45:14 user nova-compute[75239]: </disk>
Nov 13 20:45:14 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded8c097-56c6-4c7c-974e-5750027529b6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmjtfNZM {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KmjtfNZM" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8935d9f-6e00-41b1-8322-272aa717b96c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KmjtfNZM'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:14 user nova-compute[75239]: DEBUG nova.network.neutron [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Successfully created port: 6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8770e4be-972c-4e0f-806d-ef4e6075e3f3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3644496-03f5-47ce-8258-9d30c1f1b547]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:15 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:15 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.network.neutron [req-e7f49d05-95c9-46d9-95ef-9741da2e3bf2 req-88ae923f-2af1-4ddb-8468-af4248025043 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updated VIF entry in instance network info cache for port f5265dee-cd51-48a3-8c95-5b0b70e90e1f. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.network.neutron [req-e7f49d05-95c9-46d9-95ef-9741da2e3bf2 req-88ae923f-2af1-4ddb-8468-af4248025043 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating instance_info_cache with network_info: [{"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e7f49d05-95c9-46d9-95ef-9741da2e3bf2 req-88ae923f-2af1-4ddb-8468-af4248025043 service nova] Releasing lock "refresh_cache-ac9ac0ae-2f54-4130-aefa-17e7d36a5621" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[745af9d7-de9d-4317-bf1a-7b5cc900a380]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db, portal: 172.16.0.220,3260]
Nov 13 20:45:15 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:15 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d269c3-63aa-4c80-afea-68bc3d8ef11d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9954cb3b-b1c8-476d-af80-c2cfa5d2ff57]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:15 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:15 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:15 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3993a48f-bf38-44a3-a13a-defac7475a4a]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Successfully updated port: 6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquired lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-a7d0eaec-5950-4825-b45f-cf49f90fb129 req-3472da69-24ae-4bcf-99f2-500f3b047134 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-changed-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-a7d0eaec-5950-4825-b45f-cf49f90fb129 req-3472da69-24ae-4bcf-99f2-500f3b047134 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Refreshing instance network info cache due to event network-changed-6675cf99-b5e8-402b-a98e-d4190071da32. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a7d0eaec-5950-4825-b45f-cf49f90fb129 req-3472da69-24ae-4bcf-99f2-500f3b047134 service nova] Acquiring lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Releasing lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance network_info: |[{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a7d0eaec-5950-4825-b45f-cf49f90fb129 req-3472da69-24ae-4bcf-99f2-500f3b047134 service nova] Acquired lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.network.neutron [req-a7d0eaec-5950-4825-b45f-cf49f90fb129 req-3472da69-24ae-4bcf-99f2-500f3b047134 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Refreshing network info cache for port 6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Start _get_guest_xml network_info=[{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:45:15 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:15 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:45:15 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-311739780',display_name='tempest-ServerRescueNegativeTestJSON-server-311739780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-311739780',id=32,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQHU08M836BbGVao+ri5az9a01m1uenSgGJY98kRt5kmxA3tDm3mza3xC5VS+TtacpZ3tivyEPNeLEhfhn2gg2qW5JEYB4XVJ+T18O/ixYV7AxTWGA6aYw1su8KACIoNg==',key_name='tempest-keypair-1400005984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-0yuevxk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:45:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b27083a4000d4ba2832a394b9140b530',uuid=a9ed319e-d732-4930-89b4-7a61ea6cf930,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:36:75,bridge_name='br-int',has_traffic_filtering=True,id=6675cf99-b5e8-402b-a98e-d4190071da32,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6675cf99-b5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.objects.instance [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'pci_devices' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:45:16 user nova-compute[75239]:   <uuid>a9ed319e-d732-4930-89b4-7a61ea6cf930</uuid>
Nov 13 20:45:16 user nova-compute[75239]:   <name>instance-00000020</name>
Nov 13 20:45:16 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:45:16 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:45:16 user nova-compute[75239]:   <metadata>
Nov 13 20:45:16 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:45:16 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:45:16 user nova-compute[75239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-311739780</nova:name>
Nov 13 20:45:16 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:45:15</nova:creationTime>
Nov 13 20:45:16 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:45:16 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:45:16 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:45:16 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:45:16 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:45:16 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:45:16 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:45:16 user nova-compute[75239]:       <nova:owner>
Nov 13 20:45:16 user nova-compute[75239]:         <nova:user uuid="b27083a4000d4ba2832a394b9140b530">tempest-ServerRescueNegativeTestJSON-1212200086-project-member</nova:user>
Nov 13 20:45:16 user nova-compute[75239]:         <nova:project uuid="41532512e3494bfd9051c340c2557bfe">tempest-ServerRescueNegativeTestJSON-1212200086</nova:project>
Nov 13 20:45:16 user nova-compute[75239]:       </nova:owner>
Nov 13 20:45:16 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:45:16 user nova-compute[75239]:       <nova:ports>
Nov 13 20:45:16 user nova-compute[75239]:         <nova:port uuid="6675cf99-b5e8-402b-a98e-d4190071da32">
Nov 13 20:45:16 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 20:45:16 user nova-compute[75239]:         </nova:port>
Nov 13 20:45:16 user nova-compute[75239]:       </nova:ports>
Nov 13 20:45:16 user nova-compute[75239]:     </nova:instance>
Nov 13 20:45:16 user nova-compute[75239]:   </metadata>
Nov 13 20:45:16 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:45:16 user nova-compute[75239]:     <system>
Nov 13 20:45:16 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:45:16 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:45:16 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:45:16 user nova-compute[75239]:       <entry name="serial">a9ed319e-d732-4930-89b4-7a61ea6cf930</entry>
Nov 13 20:45:16 user nova-compute[75239]:       <entry name="uuid">a9ed319e-d732-4930-89b4-7a61ea6cf930</entry>
Nov 13 20:45:16 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:45:16 user nova-compute[75239]:     </system>
Nov 13 20:45:16 user nova-compute[75239]:   </sysinfo>
Nov 13 20:45:16 user nova-compute[75239]:   <os>
Nov 13 20:45:16 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:45:16 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:45:16 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:45:16 user nova-compute[75239]:   </os>
Nov 13 20:45:16 user nova-compute[75239]:   <features>
Nov 13 20:45:16 user nova-compute[75239]:     <acpi/>
Nov 13 20:45:16 user nova-compute[75239]:     <apic/>
Nov 13 20:45:16 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:45:16 user nova-compute[75239]:   </features>
Nov 13 20:45:16 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:45:16 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:45:16 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:45:16 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:45:16 user nova-compute[75239]:   </clock>
Nov 13 20:45:16 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:45:16 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:45:16 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:45:16 user nova-compute[75239]:   </cpu>
Nov 13 20:45:16 user nova-compute[75239]:   <devices>
Nov 13 20:45:16 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:45:16 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:45:16 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk"/>
Nov 13 20:45:16 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:45:16 user nova-compute[75239]:     </disk>
Nov 13 20:45:16 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:45:16 user nova-compute[75239]:       <mac address="fa:16:3e:f3:36:75"/>
Nov 13 20:45:16 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:45:16 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:45:16 user nova-compute[75239]:       <target dev="tap6675cf99-b5"/>
Nov 13 20:45:16 user nova-compute[75239]:     </interface>
Nov 13 20:45:16 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:45:16 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/console.log" append="off"/>
Nov 13 20:45:16 user nova-compute[75239]:     </serial>
Nov 13 20:45:16 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:45:16 user nova-compute[75239]:     <video>
Nov 13 20:45:16 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:45:16 user nova-compute[75239]:     </video>
Nov 13 20:45:16 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:45:16 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:45:16 user nova-compute[75239]:     </rng>
Nov 13 20:45:16 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:45:16 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:45:16 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:45:16 user nova-compute[75239]:     </memballoon>
Nov 13 20:45:16 user nova-compute[75239]:   </devices>
Nov 13 20:45:16 user nova-compute[75239]: </domain>
Nov 13 20:45:16 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-311739780',display_name='tempest-ServerRescueNegativeTestJSON-server-311739780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-311739780',id=32,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQHU08M836BbGVao+ri5az9a01m1uenSgGJY98kRt5kmxA3tDm3mza3xC5VS+TtacpZ3tivyEPNeLEhfhn2gg2qW5JEYB4XVJ+T18O/ixYV7AxTWGA6aYw1su8KACIoNg==',key_name='tempest-keypair-1400005984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-0yuevxk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:45:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b27083a4000d4ba2832a394b9140b530',uuid=a9ed319e-d732-4930-89b4-7a61ea6cf930,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:36:75,bridge_name='br-int',has_traffic_filtering=True,id=6675cf99-b5e8-402b-a98e-d4190071da32,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6675cf99-b5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG os_vif [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:36:75,bridge_name='br-int',has_traffic_filtering=True,id=6675cf99-b5e8-402b-a98e-d4190071da32,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6675cf99-b5') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81f10cc2-9dcf-50f7-8ddc-1eeb9c4ae3d5', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6675cf99-b5, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6675cf99-b5, col_values=(('qos', UUID('205e182b-2ebb-471c-9adc-87a2e9cbe38e')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6675cf99-b5, col_values=(('external_ids', {'iface-id': '6675cf99-b5e8-402b-a98e-d4190071da32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:36:75', 'vm-uuid': 'a9ed319e-d732-4930-89b4-7a61ea6cf930'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:16 user nova-compute[75239]: INFO os_vif [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:36:75,bridge_name='br-int',has_traffic_filtering=True,id=6675cf99-b5e8-402b-a98e-d4190071da32,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6675cf99-b5')
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No VIF found with MAC fa:16:3e:f3:36:75, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmjtfNZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23033393462336434', 'path': '/dev/sdg'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033393462336434', 'path': '/dev/sdg'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:45:16 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:16 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:45:16 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:45:16 user nova-compute[75239]:   <serial>ba1c8074-56da-4c04-b8dc-27016331f7db</serial>
Nov 13 20:45:16 user nova-compute[75239]: </disk>
Nov 13 20:45:16 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.network.neutron [req-a7d0eaec-5950-4825-b45f-cf49f90fb129 req-3472da69-24ae-4bcf-99f2-500f3b047134 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updated VIF entry in instance network info cache for port 6675cf99-b5e8-402b-a98e-d4190071da32. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG nova.network.neutron [req-a7d0eaec-5950-4825-b45f-cf49f90fb129 req-3472da69-24ae-4bcf-99f2-500f3b047134 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a7d0eaec-5950-4825-b45f-cf49f90fb129 req-3472da69-24ae-4bcf-99f2-500f3b047134 service nova] Releasing lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:45:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:45:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No VIF found with MAC fa:16:3e:07:d6:c8, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:45:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b330efa9-db31-47b9-aa9d-0b26f5017e8c tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.256s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-09ab88b2-4d6d-4b46-820c-21e351d4b25a req-4ba37913-b15d-4e6f-af02-15cd72b57ce0 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-09ab88b2-4d6d-4b46-820c-21e351d4b25a req-4ba37913-b15d-4e6f-af02-15cd72b57ce0 service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-09ab88b2-4d6d-4b46-820c-21e351d4b25a req-4ba37913-b15d-4e6f-af02-15cd72b57ce0 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-09ab88b2-4d6d-4b46-820c-21e351d4b25a req-4ba37913-b15d-4e6f-af02-15cd72b57ce0 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-09ab88b2-4d6d-4b46-820c-21e351d4b25a req-4ba37913-b15d-4e6f-af02-15cd72b57ce0 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:18 user nova-compute[75239]: WARNING nova.compute.manager [req-09ab88b2-4d6d-4b46-820c-21e351d4b25a req-4ba37913-b15d-4e6f-af02-15cd72b57ce0 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state building and task_state spawning.
Nov 13 20:45:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:19 user nova-compute[75239]: INFO nova.compute.manager [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Unshelving
Nov 13 20:45:19 user nova-compute[75239]: INFO nova.virt.block_device [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Booting with volume c41538ee-cd29-4af9-b597-09cfc25852c6 at /dev/vda
Nov 13 20:45:19 user nova-compute[75239]: DEBUG os_brick.utils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e948e82e-fc4b-4ceb-bfda-ed061dc57d33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c2ed68-96fc-4732-88b4-7cbf2049bbf6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[12df4cb6-6ba0-4bca-931c-4630a5349f9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[230886c3-c380-4753-b331-1971a3b02588]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:19 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c1671-62d8-466d-a898-eb13e1922653]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG os_brick.utils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating existing volume attachment record: 4726223e-9eb4-4d09-8c0d-e0a9d77dec26 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.230s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-e317b4cb-b136-41cb-aa60-172e103324c2 req-e4341b89-3c88-47ce-becd-2a2ac7f5fbe6 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e317b4cb-b136-41cb-aa60-172e103324c2 req-e4341b89-3c88-47ce-becd-2a2ac7f5fbe6 service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e317b4cb-b136-41cb-aa60-172e103324c2 req-e4341b89-3c88-47ce-becd-2a2ac7f5fbe6 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e317b4cb-b136-41cb-aa60-172e103324c2 req-e4341b89-3c88-47ce-becd-2a2ac7f5fbe6 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-e317b4cb-b136-41cb-aa60-172e103324c2 req-e4341b89-3c88-47ce-becd-2a2ac7f5fbe6 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:20 user nova-compute[75239]: WARNING nova.compute.manager [req-e317b4cb-b136-41cb-aa60-172e103324c2 req-e4341b89-3c88-47ce-becd-2a2ac7f5fbe6 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state building and task_state spawning.
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:20 user nova-compute[75239]: INFO nova.compute.manager [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Attaching volume 998427ca-f3aa-40a0-9823-e8a7def3610e to /dev/vdc
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:45:20 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance spawned successfully.
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG os_brick.utils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f34a07-6f92-43e7-901a-94a629a589bd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[792cbd99-9034-4daa-b479-64ea55df5b07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebb4749-584a-4a8c-8ac9-abf6d1ae8cad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a438b97-fbb8-4be6-aed5-8b33517f9992]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:45:20 user nova-compute[75239]: INFO nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Took 6.77 seconds to spawn the instance on the hypervisor.
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:20 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e1bd7f-1fbe-4d7b-9780-e2faecc930ea]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG os_brick.utils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:20 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Updating existing volume attachment record: bb01f9fd-03ac-4d23-8539-d230ab8c7f7d {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:45:20 user nova-compute[75239]: INFO nova.compute.manager [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Took 7.90 seconds to build instance.
Nov 13 20:45:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-aeb1f221-6e65-4c3f-beda-7e108a487fb9 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.048s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:24 user nova-compute[75239]: DEBUG nova.objects.instance [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lazy-loading 'pci_requests' on Instance uuid d6efe568-bf8d-4342-bb0e-0a878f7cccf3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:24 user nova-compute[75239]: DEBUG nova.objects.instance [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lazy-loading 'numa_topology' on Instance uuid d6efe568-bf8d-4342-bb0e-0a878f7cccf3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:24 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:45:24 user nova-compute[75239]: INFO nova.compute.claims [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Claim successful on node user
Nov 13 20:45:24 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Port 112c3460-96e2-4760-b161-d7a6fd9b3535 binding to destination host user is already ACTIVE {{(pid=75239) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 20:45:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquired lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:24 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.689s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:25 user nova-compute[75239]: INFO nova.network.neutron [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating port 0b40e357-282b-4698-9af6-41acd4aa408b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating instance_info_cache with network_info: [{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Releasing lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Creating tmpfile /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/tmpxl7giy00 to verify with other compute node that the instance is on the same shared storage. {{(pid=75239) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMhKxXtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:25 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:25 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:25 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7464865-100a-4e52-b448-1bdb71ac78f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:45:25 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe96a9ae-a32b-4d8d-9474-a5b8d560d8a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e] added
Nov 13 20:45:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[196ec95a-391a-42d9-b8d8-e7f5f5cc3bc7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4226ec-8431-44df-b4cc-7cf4d157f062]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMhKxXtb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YMhKxXtb" returned: 0 in 0.137s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d41116-d1e4-4313-bf50-b509c521677b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YMhKxXtb'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[32306c8a-d01a-4bd7-9f45-ec1b3c5810b6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa93f500-69bf-4df1-881e-4cda8db9d517]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-fbf505bc-4034-4f7e-9e04-1683729912db req-767f3e97-c946-4744-a9da-c95a8b42b4de service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-unplugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fbf505bc-4034-4f7e-9e04-1683729912db req-767f3e97-c946-4744-a9da-c95a8b42b4de service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fbf505bc-4034-4f7e-9e04-1683729912db req-767f3e97-c946-4744-a9da-c95a8b42b4de service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fbf505bc-4034-4f7e-9e04-1683729912db req-767f3e97-c946-4744-a9da-c95a8b42b4de service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-fbf505bc-4034-4f7e-9e04-1683729912db req-767f3e97-c946-4744-a9da-c95a8b42b4de service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-unplugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:25 user nova-compute[75239]: WARNING nova.compute.manager [req-fbf505bc-4034-4f7e-9e04-1683729912db req-767f3e97-c946-4744-a9da-c95a8b42b4de service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-unplugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state resized and task_state resize_reverting.
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31a6e49-5a20-44d1-8f1c-5aacb56a7d6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e, portal: 172.16.0.220,3260]
Nov 13 20:45:25 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d9bdb4-df64-49e1-9a8a-a5ec0b5b7255]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32f21da-522e-400f-9448-dcd5e133f82c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:25 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:25 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.464s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] HCTL ('39', '-', '-', 0) found on session 38 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b72fe6-37c0-4ea9-8d4c-14f9d5421abb]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Searching for a device in session 38 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMhKxXtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquired lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:25 user nova-compute[75239]: DEBUG nova.network.neutron [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-19b772e0-cdcd-4c34-b0f5-8e1cba6ee68c req-0d276c58-9ad6-4c1e-916b-97ac0132c53f service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-19b772e0-cdcd-4c34-b0f5-8e1cba6ee68c req-0d276c58-9ad6-4c1e-916b-97ac0132c53f service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing instance network info cache due to event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-19b772e0-cdcd-4c34-b0f5-8e1cba6ee68c req-0d276c58-9ad6-4c1e-916b-97ac0132c53f service nova] Acquiring lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance destroyed successfully.
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lazy-loading 'resources' on Instance uuid e92c1cc5-07e5-4bd2-8e58-e397e16b1300 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-16569669',display_name='tempest-ServerActionsTestOtherB-server-16569669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-16569669',id=22,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3cgFTuxZU0r1DOz9OMgd6sE59YAs74F2EMnqYDQDB93Sr2devQa1xYepd0PJ2KrqjVYzoEFlJaWxo0ebxb5mBVEX1HkJ8Mn4KaHB/8mBjirpfPmOT2iYwed690kLau+A==',key_name='tempest-keypair-1787385900',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:43:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4d33674f2f4221a2a17f5510135ba8',ramdisk_id='',reservation_id='r-cxa24fp9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-94146296',owner_user_name='tempest-ServerActionsTestOtherB-94146296-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:43:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c880ecddd16344ae92fdd8916db586d5',uuid=e92c1cc5-07e5-4bd2-8e58-e397e16b1300,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converting VIF {"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_vif [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap112c3460-96, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf88c687-5db0-4a45-a82c-3305541ef334) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:45:26 user nova-compute[75239]: INFO os_vif [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96')
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.network.neutron [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:26 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Releasing lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:45:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Creating image(s)
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Ensure instance console log exists: /opt/stack/data/nova/instances/d6efe568-bf8d-4342-bb0e-0a878f7cccf3/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Start _get_guest_xml network_info=[{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '4726223e-9eb4-4d09-8c0d-e0a9d77dec26', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKRGSQhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6efe568-bf8d-4342-bb0e-0a878f7cccf3', 'attached_at': '', 'detached_at': '', 'volume_id': 'c41538ee-cd29-4af9-b597-09cfc25852c6', 'serial': 'c41538ee-cd29-4af9-b597-09cfc25852c6'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-19b772e0-cdcd-4c34-b0f5-8e1cba6ee68c req-0d276c58-9ad6-4c1e-916b-97ac0132c53f service nova] Acquired lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.network.neutron [req-19b772e0-cdcd-4c34-b0f5-8e1cba6ee68c req-0d276c58-9ad6-4c1e-916b-97ac0132c53f service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:45:26 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:26 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.objects.instance [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lazy-loading 'vcpu_model' on Instance uuid d6efe568-bf8d-4342-bb0e-0a878f7cccf3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.objects.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Object Instance<d6efe568-bf8d-4342-bb0e-0a878f7cccf3> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKRGSQhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:26 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.network.neutron [req-19b772e0-cdcd-4c34-b0f5-8e1cba6ee68c req-0d276c58-9ad6-4c1e-916b-97ac0132c53f service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updated VIF entry in instance network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.network.neutron [req-19b772e0-cdcd-4c34-b0f5-8e1cba6ee68c req-0d276c58-9ad6-4c1e-916b-97ac0132c53f service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-19b772e0-cdcd-4c34-b0f5-8e1cba6ee68c req-0d276c58-9ad6-4c1e-916b-97ac0132c53f service nova] Releasing lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.512s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '23039343730303036', 'path': '/dev/sdh'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039343730303036', 'path': '/dev/sdh'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.461s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76546a8a-716e-4eec-9734-02bfb50f2294]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:45:26 user nova-compute[75239]: No targets found.
Nov 13 20:45:26 user nova-compute[75239]: iSNS:
Nov 13 20:45:26 user nova-compute[75239]: No targets found.
Nov 13 20:45:26 user nova-compute[75239]: STATIC:
Nov 13 20:45:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:45:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca
Nov 13 20:45:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:45:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:45:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db
Nov 13 20:45:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e
Nov 13 20:45:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b
Nov 13 20:45:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:26 user nova-compute[75239]: FIRMWARE:
Nov 13 20:45:26 user nova-compute[75239]: No targets found.
Nov 13 20:45:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:45:26 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:45:26 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:45:26 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:26 user nova-compute[75239]:   <source dev="/dev/sdh"/>
Nov 13 20:45:26 user nova-compute[75239]:   <target dev="vdc" bus="virtio"/>
Nov 13 20:45:26 user nova-compute[75239]:   <serial>998427ca-f3aa-40a0-9823-e8a7def3610e</serial>
Nov 13 20:45:26 user nova-compute[75239]: </disk>
Nov 13 20:45:26 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76832b89-677f-488e-8d4b-1a1d0261219a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdadc930-1201-4450-9a75-c4fd8f840a22]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:26 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60596b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7890683a-d38a-4ac9-b055-cf791cd7c2e7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac5a65e-862c-4bc4-9028-8b98cc8b9a5b]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01f00cb-947b-4446-b2b6-c39c992e9ebb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:45:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[757fc923-98b9-4767-9f8c-0d52b6bce51c]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5223f0-0019-4d44-b8f2-196fce2997a6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2248a9d3-5d5b-4107-b353-de74a7df0d9a]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]
Nov 13 20:45:27 user nova-compute[75239]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f50b82-b3ac-4bb2-9982-32adaf9b4667]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] <== disconnect_volume: return (792ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.693s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:27 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:27 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b85629-6a8d-4cf9-a058-3a9999d95595]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:45:27 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9f49d0-c5c9-4397-aaec-c4ac7a5aa4b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6] added
Nov 13 20:45:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d86a78-c9ab-4f35-ae87-761f617a4756]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f07ff2b-ed75-4682-afb2-0f9245b21033]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] No VIF found with MAC fa:16:3e:07:d6:c8, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKRGSQhW {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKRGSQhW" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f76f344-5f62-452b-8d98-4fccf3a69479]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKRGSQhW'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[339c3751-3b12-47ef-b009-b2887f1d60e5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d648c077-1e5f-41c7-b340-8a4502a193b6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4ec46c2a-678a-435f-82e8-b16005ab9335 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.044s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[425ef955-6632-4aa0-b0c9-4a1040563d72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260]
Nov 13 20:45:27 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e095b920-306a-4629-87f7-c4d92d901621]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8497e3-5ea3-4f44-84fc-4a5e26b297a9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:27 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:27 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb597b4f-423f-4ce5-b3d9-0f1d95af8842]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKRGSQhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-e5669fa5-5f0b-48af-9f01-48a7db0f5b09 req-4cf637b1-c7d9-4145-b0df-f3a25508f176 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e5669fa5-5f0b-48af-9f01-48a7db0f5b09 req-4cf637b1-c7d9-4145-b0df-f3a25508f176 service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e5669fa5-5f0b-48af-9f01-48a7db0f5b09 req-4cf637b1-c7d9-4145-b0df-f3a25508f176 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e5669fa5-5f0b-48af-9f01-48a7db0f5b09 req-4cf637b1-c7d9-4145-b0df-f3a25508f176 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-e5669fa5-5f0b-48af-9f01-48a7db0f5b09 req-4cf637b1-c7d9-4145-b0df-f3a25508f176 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:27 user nova-compute[75239]: WARNING nova.compute.manager [req-e5669fa5-5f0b-48af-9f01-48a7db0f5b09 req-4cf637b1-c7d9-4145-b0df-f3a25508f176 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state resized and task_state resize_reverting.
Nov 13 20:45:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lazy-loading 'migration_context' on Instance uuid e92c1cc5-07e5-4bd2-8e58-e397e16b1300 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.objects.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Object Instance<e92c1cc5-07e5-4bd2-8e58-e397e16b1300> lazy-loaded attributes: resources,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:28 user nova-compute[75239]: INFO nova.compute.manager [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Detaching volume ba1c8074-56da-4c04-b8dc-27016331f7db
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:45:28 user nova-compute[75239]: INFO nova.virt.block_device [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Attempting to driver detach volume ba1c8074-56da-4c04-b8dc-27016331f7db from mountpoint /dev/vdb
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Attempting to detach device vdb from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:45:28 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:28 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:45:28 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:45:28 user nova-compute[75239]:   <serial>ba1c8074-56da-4c04-b8dc-27016331f7db</serial>
Nov 13 20:45:28 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:45:28 user nova-compute[75239]: </disk>
Nov 13 20:45:28 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] <== connect_volume: return (2074ms) {'type': 'block', 'scsi_wwn': '26332316431316130', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332316431316130', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:45:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully detached device vdb from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e from the persistent domain config.
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:45:28 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:28 user nova-compute[75239]:   <source dev="/dev/sdg"/>
Nov 13 20:45:28 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:45:28 user nova-compute[75239]:   <serial>ba1c8074-56da-4c04-b8dc-27016331f7db</serial>
Nov 13 20:45:28 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:45:28 user nova-compute[75239]: </disk>
Nov 13 20:45:28 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.573s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1104629884',display_name='tempest-TestShelveInstance-server-1104629884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1104629884',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-438861881',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:41:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b4a480ab579c451799fbaac4af653379',ramdisk_id='',reservation_id='r-febrlktk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1910953819',owner_user_name='tempest-TestShelveInstance-1910953819-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:45:19Z,user_data=None,user_id='41ee3d20cab9440d9564a3b536668fda',uuid=d6efe568-bf8d-4342-bb0e-0a878f7cccf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converting VIF {"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lazy-loading 'pci_devices' on Instance uuid d6efe568-bf8d-4342-bb0e-0a878f7cccf3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.objects.base [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Object Instance<d6efe568-bf8d-4342-bb0e-0a878f7cccf3> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:45:28 user nova-compute[75239]:   <uuid>d6efe568-bf8d-4342-bb0e-0a878f7cccf3</uuid>
Nov 13 20:45:28 user nova-compute[75239]:   <name>instance-0000001a</name>
Nov 13 20:45:28 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:45:28 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:45:28 user nova-compute[75239]:   <metadata>
Nov 13 20:45:28 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:45:28 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:45:28 user nova-compute[75239]:       <nova:name>tempest-TestShelveInstance-server-1104629884</nova:name>
Nov 13 20:45:28 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:45:26</nova:creationTime>
Nov 13 20:45:28 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:45:28 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:45:28 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:45:28 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:45:28 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:45:28 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:45:28 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:45:28 user nova-compute[75239]:       <nova:owner>
Nov 13 20:45:28 user nova-compute[75239]:         <nova:user uuid="41ee3d20cab9440d9564a3b536668fda">tempest-TestShelveInstance-1910953819-project-member</nova:user>
Nov 13 20:45:28 user nova-compute[75239]:         <nova:project uuid="b4a480ab579c451799fbaac4af653379">tempest-TestShelveInstance-1910953819</nova:project>
Nov 13 20:45:28 user nova-compute[75239]:       </nova:owner>
Nov 13 20:45:28 user nova-compute[75239]:       <nova:ports>
Nov 13 20:45:28 user nova-compute[75239]:         <nova:port uuid="0b40e357-282b-4698-9af6-41acd4aa408b">
Nov 13 20:45:28 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 20:45:28 user nova-compute[75239]:         </nova:port>
Nov 13 20:45:28 user nova-compute[75239]:       </nova:ports>
Nov 13 20:45:28 user nova-compute[75239]:     </nova:instance>
Nov 13 20:45:28 user nova-compute[75239]:   </metadata>
Nov 13 20:45:28 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:45:28 user nova-compute[75239]:     <system>
Nov 13 20:45:28 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:45:28 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:45:28 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:45:28 user nova-compute[75239]:       <entry name="serial">d6efe568-bf8d-4342-bb0e-0a878f7cccf3</entry>
Nov 13 20:45:28 user nova-compute[75239]:       <entry name="uuid">d6efe568-bf8d-4342-bb0e-0a878f7cccf3</entry>
Nov 13 20:45:28 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:45:28 user nova-compute[75239]:     </system>
Nov 13 20:45:28 user nova-compute[75239]:   </sysinfo>
Nov 13 20:45:28 user nova-compute[75239]:   <os>
Nov 13 20:45:28 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:45:28 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:45:28 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:45:28 user nova-compute[75239]:   </os>
Nov 13 20:45:28 user nova-compute[75239]:   <features>
Nov 13 20:45:28 user nova-compute[75239]:     <acpi/>
Nov 13 20:45:28 user nova-compute[75239]:     <apic/>
Nov 13 20:45:28 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:45:28 user nova-compute[75239]:   </features>
Nov 13 20:45:28 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:45:28 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:45:28 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:45:28 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:45:28 user nova-compute[75239]:   </clock>
Nov 13 20:45:28 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:45:28 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:45:28 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:45:28 user nova-compute[75239]:   </cpu>
Nov 13 20:45:28 user nova-compute[75239]:   <devices>
Nov 13 20:45:28 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:45:28 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:28 user nova-compute[75239]:       <source dev="/dev/sdc"/>
Nov 13 20:45:28 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:45:28 user nova-compute[75239]:       <serial>c41538ee-cd29-4af9-b597-09cfc25852c6</serial>
Nov 13 20:45:28 user nova-compute[75239]:     </disk>
Nov 13 20:45:28 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:45:28 user nova-compute[75239]:       <mac address="fa:16:3e:9d:cb:d3"/>
Nov 13 20:45:28 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:45:28 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:45:28 user nova-compute[75239]:       <target dev="tap0b40e357-28"/>
Nov 13 20:45:28 user nova-compute[75239]:     </interface>
Nov 13 20:45:28 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:45:28 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/d6efe568-bf8d-4342-bb0e-0a878f7cccf3/console.log" append="off"/>
Nov 13 20:45:28 user nova-compute[75239]:     </serial>
Nov 13 20:45:28 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:45:28 user nova-compute[75239]:     <video>
Nov 13 20:45:28 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:45:28 user nova-compute[75239]:     </video>
Nov 13 20:45:28 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:45:28 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:45:28 user nova-compute[75239]:     </rng>
Nov 13 20:45:28 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:45:28 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:45:28 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:45:28 user nova-compute[75239]:     </memballoon>
Nov 13 20:45:28 user nova-compute[75239]:   </devices>
Nov 13 20:45:28 user nova-compute[75239]: </domain>
Nov 13 20:45:28 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1104629884',display_name='tempest-TestShelveInstance-server-1104629884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1104629884',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-438861881',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:41:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b4a480ab579c451799fbaac4af653379',ramdisk_id='',reservation_id='r-febrlktk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1910953819',owner_user_name='tempest-TestShelveInstance-1910953819-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:45:19Z,user_data=None,user_id='41ee3d20cab9440d9564a3b536668fda',uuid=d6efe568-bf8d-4342-bb0e-0a878f7cccf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converting VIF {"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG os_vif [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bbf2f20-55cb-583f-aac5-4e9597c8e4e8', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b40e357-28, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b40e357-28, col_values=(('qos', UUID('79bf8297-a160-44cb-b8dc-64011a1de45c')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b40e357-28, col_values=(('external_ids', {'iface-id': '0b40e357-282b-4698-9af6-41acd4aa408b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:cb:d3', 'vm-uuid': 'd6efe568-bf8d-4342-bb0e-0a878f7cccf3'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:28 user nova-compute[75239]: INFO os_vif [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28')
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] No VIF found with MAC fa:16:3e:9d:cb:d3, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:45:28 user nova-compute[75239]: INFO nova.compute.manager [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Swapping old allocation on dict_keys(['6c1abe79-622f-4b7b-89fd-35e20ccec6d4']) held by migration a3295796-2e28-4571-be82-dd0701892400 for instance
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Overwriting current allocation {'allocations': {'6c1abe79-622f-4b7b-89fd-35e20ccec6d4': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 38}}, 'project_id': '0f4d33674f2f4221a2a17f5510135ba8', 'user_id': 'c880ecddd16344ae92fdd8916db586d5', 'consumer_generation': 1} on consumer e92c1cc5-07e5-4bd2-8e58-e397e16b1300 {{(pid=75239) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquired lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:45:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating instance_info_cache with network_info: [{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Releasing lock "refresh_cache-e92c1cc5-07e5-4bd2-8e58-e397e16b1300" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG os_brick.utils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a171bad-9e8f-4d67-a0df-2b49e61bb9af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45446f5-22d9-4d6d-9ab1-c4b384492709]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d500a81-aaef-4f49-be11-7436cbe0abe2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedbde3f-3712-4eac-bdcd-77ea52875233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:29 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:45:29 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efbdd7d-1136-40cb-958c-f9c6c306bcce]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:45:29 user nova-compute[75239]: DEBUG os_brick.utils [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-2c0e22b9-cfc7-4428-a204-281ada7cdb58 req-8f9bf84d-c92b-47f9-8e8a-58eea40e5446 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2c0e22b9-cfc7-4428-a204-281ada7cdb58 req-8f9bf84d-c92b-47f9-8e8a-58eea40e5446 service nova] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2c0e22b9-cfc7-4428-a204-281ada7cdb58 req-8f9bf84d-c92b-47f9-8e8a-58eea40e5446 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2c0e22b9-cfc7-4428-a204-281ada7cdb58 req-8f9bf84d-c92b-47f9-8e8a-58eea40e5446 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-2c0e22b9-cfc7-4428-a204-281ada7cdb58 req-8f9bf84d-c92b-47f9-8e8a-58eea40e5446 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] No waiting events found dispatching network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:30 user nova-compute[75239]: WARNING nova.compute.manager [req-2c0e22b9-cfc7-4428-a204-281ada7cdb58 req-8f9bf84d-c92b-47f9-8e8a-58eea40e5446 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received unexpected event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 20:45:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:45:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:45:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Instance spawned successfully.
Nov 13 20:45:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:45:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5d8a4ef6-637f-465a-ad8a-e5f37af364e9 tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.302s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-32818c3e-fcf0-46a3-93fb-c58f9a8d7b01 req-feb8523c-cc17-4511-becc-5534cd7585e1 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-32818c3e-fcf0-46a3-93fb-c58f9a8d7b01 req-feb8523c-cc17-4511-becc-5534cd7585e1 service nova] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-32818c3e-fcf0-46a3-93fb-c58f9a8d7b01 req-feb8523c-cc17-4511-becc-5534cd7585e1 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-32818c3e-fcf0-46a3-93fb-c58f9a8d7b01 req-feb8523c-cc17-4511-becc-5534cd7585e1 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-32818c3e-fcf0-46a3-93fb-c58f9a8d7b01 req-feb8523c-cc17-4511-becc-5534cd7585e1 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] No waiting events found dispatching network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:32 user nova-compute[75239]: WARNING nova.compute.manager [req-32818c3e-fcf0-46a3-93fb-c58f9a8d7b01 req-feb8523c-cc17-4511-becc-5534cd7585e1 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received unexpected event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b for instance with vm_state active and task_state None.
Nov 13 20:45:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Starting finish_revert_migration {{(pid=75239) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Start _get_guest_xml network_info=[{"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '197ad495-0e7f-47e6-9c17-b53214a4e0c3', 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e92c1cc5-07e5-4bd2-8e58-e397e16b1300', 'attached_at': '2023-11-13T20:45:34.000000', 'detached_at': '', 'volume_id': '6b50271f-67dd-4e52-8842-19f690a4cd9b', 'serial': '6b50271f-67dd-4e52-8842-19f690a4cd9b'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:45:34 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:34 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lazy-loading 'vcpu_model' on Instance uuid e92c1cc5-07e5-4bd2-8e58-e397e16b1300 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:34 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:34 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:34 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcf14b3-20ff-46f4-9aeb-577a5d96c103]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:45:34 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[311a5b00-8041-41d7-8b8d-85bfa11930e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b] added
Nov 13 20:45:34 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee872c81-3667-4182-b034-4da64e406ec4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a9df0f-a06b-4764-a035-ea7e06307935]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrmTOSFB {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrmTOSFB" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db7e573-5116-40d6-9c4e-3da7c240ae10]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrmTOSFB'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f520ce3-33bc-4288-9895-93d275927ce9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bedda5-741a-4bd3-a9f8-0baea75c98b8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:34 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:34 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2420972e-950c-4f8e-86e6-a3d540cf9dec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]
Nov 13 20:45:34 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:34 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f513d7e3-fa54-4bff-96c8-49b5e2777119]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee89d93-7d4a-4549-b503-244939b4877d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:34 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:34 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:34 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] HCTL ('40', '-', '-', 0) found on session 40 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[10feea6a-db6d-4f80-aaa0-d92cd087d5b7]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Searching for a device in session 40 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 is timed out.
Nov 13 20:45:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully detached device vdb from instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 from the live domain config.
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gZPtAaiF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:35 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '26565303163353563', 'path': '/dev/sdi'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565303163353563', 'path': '/dev/sdi'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.086s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a54423a-31e7-4ca4-a8f9-5e31b1af5865]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:45:35 user nova-compute[75239]: No targets found.
Nov 13 20:45:35 user nova-compute[75239]: iSNS:
Nov 13 20:45:35 user nova-compute[75239]: No targets found.
Nov 13 20:45:35 user nova-compute[75239]: STATIC:
Nov 13 20:45:35 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:45:35 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:35 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:35 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca
Nov 13 20:45:35 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:35 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:35 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:45:35 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:35 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:35 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:45:35 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:35 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:35 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db
Nov 13 20:45:35 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:35 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:35 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e
Nov 13 20:45:35 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:35 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:35 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6
Nov 13 20:45:35 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:35 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:35 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b
Nov 13 20:45:35 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:35 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:35 user nova-compute[75239]: FIRMWARE:
Nov 13 20:45:35 user nova-compute[75239]: No targets found.
Nov 13 20:45:35 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:45:35 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:45:35 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7451f4cc-e6e4-4eb0-92a1-d9335bae5f86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[876361c1-7168-482f-9760-9a6aa564d7ca]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:35 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:35 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:35 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60219b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca'): ({'sdd'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Removing single pathed devices sdd {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8308cca-c1d1-4d9b-a620-8291a1e206d3]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-16569669',display_name='tempest-ServerActionsTestOtherB-server-16569669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-16569669',id=22,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3cgFTuxZU0r1DOz9OMgd6sE59YAs74F2EMnqYDQDB93Sr2devQa1xYepd0PJ2KrqjVYzoEFlJaWxo0ebxb5mBVEX1HkJ8Mn4KaHB/8mBjirpfPmOT2iYwed690kLau+A==',key_name='tempest-keypair-1787385900',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:43:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f4d33674f2f4221a2a17f5510135ba8',ramdisk_id='',reservation_id='r-cxa24fp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-94146296',owner_user_name='tempest-ServerActionsTestOtherB-94146296-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c880ecddd16344ae92fdd8916db586d5',uuid=e92c1cc5-07e5-4bd2-8e58-e397e16b1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converting VIF {"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:45:35 user nova-compute[75239]:   <uuid>e92c1cc5-07e5-4bd2-8e58-e397e16b1300</uuid>
Nov 13 20:45:35 user nova-compute[75239]:   <name>instance-00000016</name>
Nov 13 20:45:35 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:45:35 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:45:35 user nova-compute[75239]:   <metadata>
Nov 13 20:45:35 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:45:35 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:45:35 user nova-compute[75239]:       <nova:name>tempest-ServerActionsTestOtherB-server-16569669</nova:name>
Nov 13 20:45:35 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:45:34</nova:creationTime>
Nov 13 20:45:35 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:45:35 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:45:35 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:45:35 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:45:35 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:45:35 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:45:35 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:45:35 user nova-compute[75239]:       <nova:owner>
Nov 13 20:45:35 user nova-compute[75239]:         <nova:user uuid="c880ecddd16344ae92fdd8916db586d5">tempest-ServerActionsTestOtherB-94146296-project-member</nova:user>
Nov 13 20:45:35 user nova-compute[75239]:         <nova:project uuid="0f4d33674f2f4221a2a17f5510135ba8">tempest-ServerActionsTestOtherB-94146296</nova:project>
Nov 13 20:45:35 user nova-compute[75239]:       </nova:owner>
Nov 13 20:45:35 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:45:35 user nova-compute[75239]:       <nova:ports>
Nov 13 20:45:35 user nova-compute[75239]:         <nova:port uuid="112c3460-96e2-4760-b161-d7a6fd9b3535">
Nov 13 20:45:35 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:45:35 user nova-compute[75239]:         </nova:port>
Nov 13 20:45:35 user nova-compute[75239]:       </nova:ports>
Nov 13 20:45:35 user nova-compute[75239]:     </nova:instance>
Nov 13 20:45:35 user nova-compute[75239]:   </metadata>
Nov 13 20:45:35 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:45:35 user nova-compute[75239]:     <system>
Nov 13 20:45:35 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:45:35 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:45:35 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:45:35 user nova-compute[75239]:       <entry name="serial">e92c1cc5-07e5-4bd2-8e58-e397e16b1300</entry>
Nov 13 20:45:35 user nova-compute[75239]:       <entry name="uuid">e92c1cc5-07e5-4bd2-8e58-e397e16b1300</entry>
Nov 13 20:45:35 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:45:35 user nova-compute[75239]:     </system>
Nov 13 20:45:35 user nova-compute[75239]:   </sysinfo>
Nov 13 20:45:35 user nova-compute[75239]:   <os>
Nov 13 20:45:35 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:45:35 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:45:35 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:45:35 user nova-compute[75239]:   </os>
Nov 13 20:45:35 user nova-compute[75239]:   <features>
Nov 13 20:45:35 user nova-compute[75239]:     <acpi/>
Nov 13 20:45:35 user nova-compute[75239]:     <apic/>
Nov 13 20:45:35 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:45:35 user nova-compute[75239]:   </features>
Nov 13 20:45:35 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:45:35 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:45:35 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:45:35 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:45:35 user nova-compute[75239]:   </clock>
Nov 13 20:45:35 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:45:35 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:45:35 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:45:35 user nova-compute[75239]:   </cpu>
Nov 13 20:45:35 user nova-compute[75239]:   <devices>
Nov 13 20:45:35 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:45:35 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:45:35 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk"/>
Nov 13 20:45:35 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:45:35 user nova-compute[75239]:     </disk>
Nov 13 20:45:35 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:45:35 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:35 user nova-compute[75239]:       <source dev="/dev/sdi"/>
Nov 13 20:45:35 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:45:35 user nova-compute[75239]:       <serial>6b50271f-67dd-4e52-8842-19f690a4cd9b</serial>
Nov 13 20:45:35 user nova-compute[75239]:     </disk>
Nov 13 20:45:35 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:45:35 user nova-compute[75239]:       <mac address="fa:16:3e:13:86:a6"/>
Nov 13 20:45:35 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:45:35 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:45:35 user nova-compute[75239]:       <target dev="tap112c3460-96"/>
Nov 13 20:45:35 user nova-compute[75239]:     </interface>
Nov 13 20:45:35 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:45:35 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/console.log" append="off"/>
Nov 13 20:45:35 user nova-compute[75239]:     </serial>
Nov 13 20:45:35 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:45:35 user nova-compute[75239]:     <video>
Nov 13 20:45:35 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:45:35 user nova-compute[75239]:     </video>
Nov 13 20:45:35 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:45:35 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:45:35 user nova-compute[75239]:     </rng>
Nov 13 20:45:35 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:45:35 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:45:35 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:45:35 user nova-compute[75239]:     </memballoon>
Nov 13 20:45:35 user nova-compute[75239]:   </devices>
Nov 13 20:45:35 user nova-compute[75239]: </domain>
Nov 13 20:45:35 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-16569669',display_name='tempest-ServerActionsTestOtherB-server-16569669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-16569669',id=22,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3cgFTuxZU0r1DOz9OMgd6sE59YAs74F2EMnqYDQDB93Sr2devQa1xYepd0PJ2KrqjVYzoEFlJaWxo0ebxb5mBVEX1HkJ8Mn4KaHB/8mBjirpfPmOT2iYwed690kLau+A==',key_name='tempest-keypair-1787385900',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:43:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0f4d33674f2f4221a2a17f5510135ba8',ramdisk_id='',reservation_id='r-cxa24fp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-94146296',owner_user_name='tempest-ServerActionsTestOtherB-94146296-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c880ecddd16344ae92fdd8916db586d5',uuid=e92c1cc5-07e5-4bd2-8e58-e397e16b1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converting VIF {"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_vif [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e955939-575f-42c2-8fc7-6c6bf50148ac]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Flushing IO for device /dev/sdd {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de48b76b-f3c1-5fb9-a92f-e187e43e3ade', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8973b4cc-e2c0-4994-9f20-a4e703aa9146]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap112c3460-96, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap112c3460-96, col_values=(('qos', UUID('09627da5-36bb-4cff-b3a8-bf1e81e7fbd9')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap112c3460-96, col_values=(('external_ids', {'iface-id': '112c3460-96e2-4760-b161-d7a6fd9b3535', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:86:a6', 'vm-uuid': 'e92c1cc5-07e5-4bd2-8e58-e397e16b1300'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:35 user nova-compute[75239]: INFO os_vif [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96')
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ab1627-7258-4b8e-b112-a6ea186230a1]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acdc54c-e978-4f91-9a22-e66e7aabf691]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12d97f-36f2-4a18-b6b4-126c1fa7d81d]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260]
Nov 13 20:45:36 user nova-compute[75239]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:36 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07264292-6803-485b-b4cf-8972a13855ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6920cd65-a02c-4754-83d1-5c537ecae9dc]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.535s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] <== disconnect_volume: return (621ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'flavor' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b27283eb-4128-4170-86e2-d6a44f9075a5 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.307s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-9f2c5570-0302-449e-8050-58da3414ab15 req-212f5a6c-73c4-41b8-beb7-a611968a75d2 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9f2c5570-0302-449e-8050-58da3414ab15 req-212f5a6c-73c4-41b8-beb7-a611968a75d2 service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9f2c5570-0302-449e-8050-58da3414ab15 req-212f5a6c-73c4-41b8-beb7-a611968a75d2 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9f2c5570-0302-449e-8050-58da3414ab15 req-212f5a6c-73c4-41b8-beb7-a611968a75d2 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-9f2c5570-0302-449e-8050-58da3414ab15 req-212f5a6c-73c4-41b8-beb7-a611968a75d2 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:37 user nova-compute[75239]: WARNING nova.compute.manager [req-9f2c5570-0302-449e-8050-58da3414ab15 req-212f5a6c-73c4-41b8-beb7-a611968a75d2 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state resized and task_state resize_reverting.
Nov 13 20:45:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:45:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-1981ba05-50f3-4c8b-881b-6ddc64730ddb req-46981280-dc06-4f92-8690-ac10cc33fb4d service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1981ba05-50f3-4c8b-881b-6ddc64730ddb req-46981280-dc06-4f92-8690-ac10cc33fb4d service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1981ba05-50f3-4c8b-881b-6ddc64730ddb req-46981280-dc06-4f92-8690-ac10cc33fb4d service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1981ba05-50f3-4c8b-881b-6ddc64730ddb req-46981280-dc06-4f92-8690-ac10cc33fb4d service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-1981ba05-50f3-4c8b-881b-6ddc64730ddb req-46981280-dc06-4f92-8690-ac10cc33fb4d service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:39 user nova-compute[75239]: WARNING nova.compute.manager [req-1981ba05-50f3-4c8b-881b-6ddc64730ddb req-46981280-dc06-4f92-8690-ac10cc33fb4d service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state resized and task_state resize_reverting.
Nov 13 20:45:39 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:39 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:39 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7281MB free_disk=24.747753143310547GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:45:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:39 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance running successfully.
Nov 13 20:45:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] finish_revert_migration finished successfully. {{(pid=75239) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance b24f2bf2-0c75-49c3-acce-c811f5454d8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 40d7bf6c-7117-431d-9223-8b7068f58d4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e62931e3-90bb-4959-825c-e80dfc391989 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 0ba53275-7df4-4ecf-a4cc-860975b83d5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a9ed319e-d732-4930-89b4-7a61ea6cf930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d6efe568-bf8d-4342-bb0e-0a878f7cccf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:45:40 user nova-compute[75239]: INFO nova.compute.manager [None req-6a05b456-c988-4def-8db9-4347d72f492f tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating instance to original state: 'active'
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.674s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:45:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:45:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:45:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:45:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:45:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:45:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:45:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:45:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:43 user nova-compute[75239]: INFO nova.compute.manager [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Terminating instance
Nov 13 20:45:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-e9a6b006-f088-42c4-a93d-5aade3ef6cc8 req-bbf08e4f-64fd-4975-962f-9c7cc76602f8 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received event network-vif-unplugged-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e9a6b006-f088-42c4-a93d-5aade3ef6cc8 req-bbf08e4f-64fd-4975-962f-9c7cc76602f8 service nova] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e9a6b006-f088-42c4-a93d-5aade3ef6cc8 req-bbf08e4f-64fd-4975-962f-9c7cc76602f8 service nova] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e9a6b006-f088-42c4-a93d-5aade3ef6cc8 req-bbf08e4f-64fd-4975-962f-9c7cc76602f8 service nova] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-e9a6b006-f088-42c4-a93d-5aade3ef6cc8 req-bbf08e4f-64fd-4975-962f-9c7cc76602f8 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] No waiting events found dispatching network-vif-unplugged-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-e9a6b006-f088-42c4-a93d-5aade3ef6cc8 req-bbf08e4f-64fd-4975-962f-9c7cc76602f8 service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received event network-vif-unplugged-3f327526-3f38-4901-b271-8e38739d7b59 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:45:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Instance destroyed successfully.
Nov 13 20:45:44 user nova-compute[75239]: DEBUG nova.objects.instance [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lazy-loading 'resources' on Instance uuid b24f2bf2-0c75-49c3-acce-c811f5454d8d {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:42:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1198495123',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1198495123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1198495',id=27,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZXSuyqRFoitpB1QzlI11F4CQe/UWcG2SQfE0p9ct9EjiyE05jKD+MSEctJNmJh/kT+BbE4S5akntDWT2BNjSpG1DOnAwN20pzrfudPbYznUODBqZVMd+zwRxl5vI4X+A==',key_name='tempest-keypair-309249973',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:42:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='259a798a23d94faf9e0267a4f13445da',ramdisk_id='',reservation_id='r-bk53s0z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-956936833',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d558e53105a840328eb2c0c5c2c36bfa',uuid=b24f2bf2-0c75-49c3-acce-c811f5454d8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Converting VIF {"id": "3f327526-3f38-4901-b271-8e38739d7b59", "address": "fa:16:3e:0b:da:ce", "network": {"id": "fba9f8a7-dc83-42c5-96c7-6f74323bf77e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1831675771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "259a798a23d94faf9e0267a4f13445da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f327526-3f", "ovs_interfaceid": "3f327526-3f38-4901-b271-8e38739d7b59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:da:ce,bridge_name='br-int',has_traffic_filtering=True,id=3f327526-3f38-4901-b271-8e38739d7b59,network=Network(fba9f8a7-dc83-42c5-96c7-6f74323bf77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f327526-3f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG os_vif [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:da:ce,bridge_name='br-int',has_traffic_filtering=True,id=3f327526-3f38-4901-b271-8e38739d7b59,network=Network(fba9f8a7-dc83-42c5-96c7-6f74323bf77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f327526-3f') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f327526-3f, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38977415-48fa-419e-8caf-8e3138218326) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:44 user nova-compute[75239]: INFO os_vif [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:da:ce,bridge_name='br-int',has_traffic_filtering=True,id=3f327526-3f38-4901-b271-8e38739d7b59,network=Network(fba9f8a7-dc83-42c5-96c7-6f74323bf77e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f327526-3f')
Nov 13 20:45:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Deleting instance files /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d_del
Nov 13 20:45:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Deletion of /opt/stack/data/nova/instances/b24f2bf2-0c75-49c3-acce-c811f5454d8d_del complete
Nov 13 20:45:44 user nova-compute[75239]: INFO nova.compute.manager [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 13 20:45:44 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:44 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Took 0.80 seconds to deallocate network for instance.
Nov 13 20:45:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-80956648-5d27-4849-96a3-37cffaec880e req-c60ed2ed-2802-4a61-99cf-57a52133e49f service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received event network-vif-deleted-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:45 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:45:45 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:45:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.573s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:45 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Deleted allocations for instance b24f2bf2-0c75-49c3-acce-c811f5454d8d
Nov 13 20:45:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-116bf3a4-700f-4a18-b77e-0b96571c9fd8 req-4c8c69b3-d644-4355-9ac0-3345246e917e service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received event network-vif-plugged-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-116bf3a4-700f-4a18-b77e-0b96571c9fd8 req-4c8c69b3-d644-4355-9ac0-3345246e917e service nova] Acquiring lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-116bf3a4-700f-4a18-b77e-0b96571c9fd8 req-4c8c69b3-d644-4355-9ac0-3345246e917e service nova] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-116bf3a4-700f-4a18-b77e-0b96571c9fd8 req-4c8c69b3-d644-4355-9ac0-3345246e917e service nova] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-116bf3a4-700f-4a18-b77e-0b96571c9fd8 req-4c8c69b3-d644-4355-9ac0-3345246e917e service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] No waiting events found dispatching network-vif-plugged-3f327526-3f38-4901-b271-8e38739d7b59 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:45 user nova-compute[75239]: WARNING nova.compute.manager [req-116bf3a4-700f-4a18-b77e-0b96571c9fd8 req-4c8c69b3-d644-4355-9ac0-3345246e917e service nova] [instance: b24f2bf2-0c75-49c3-acce-c811f5454d8d] Received unexpected event network-vif-plugged-3f327526-3f38-4901-b271-8e38739d7b59 for instance with vm_state deleted and task_state None.
Nov 13 20:45:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c83e7290-0d32-442d-9181-853b1dc9c9d0 tempest-TestServerVolumeAttachScenarioOldVersion-956936833 tempest-TestServerVolumeAttachScenarioOldVersion-956936833-project-member] Lock "b24f2bf2-0c75-49c3-acce-c811f5454d8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.456s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-54426dea-7356-4af6-9ada-f4e1b6c6d3cb req-6ea0a456-89e4-4705-ad0c-466bb95e6cdd service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received event network-changed-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-54426dea-7356-4af6-9ada-f4e1b6c6d3cb req-6ea0a456-89e4-4705-ad0c-466bb95e6cdd service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Refreshing instance network info cache due to event network-changed-0da27379-6537-4987-ad38-12e5e1d9f277. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:45:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-54426dea-7356-4af6-9ada-f4e1b6c6d3cb req-6ea0a456-89e4-4705-ad0c-466bb95e6cdd service nova] Acquiring lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-54426dea-7356-4af6-9ada-f4e1b6c6d3cb req-6ea0a456-89e4-4705-ad0c-466bb95e6cdd service nova] Acquired lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-54426dea-7356-4af6-9ada-f4e1b6c6d3cb req-6ea0a456-89e4-4705-ad0c-466bb95e6cdd service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Refreshing network info cache for port 0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:45:48 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e is timed out.
Nov 13 20:45:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully detached device vdb from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e from the live domain config.
Nov 13 20:45:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KmjtfNZM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:49 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[584956d1-2b63-49a3-b0b9-833c601f04c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:45:49 user nova-compute[75239]: No targets found.
Nov 13 20:45:49 user nova-compute[75239]: iSNS:
Nov 13 20:45:49 user nova-compute[75239]: No targets found.
Nov 13 20:45:49 user nova-compute[75239]: STATIC:
Nov 13 20:45:49 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:45:49 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:49 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:49 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:45:49 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:49 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:49 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:45:49 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:49 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:49 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db
Nov 13 20:45:49 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:49 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:49 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e
Nov 13 20:45:49 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:49 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:49 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6
Nov 13 20:45:49 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:49 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:49 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b
Nov 13 20:45:49 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:49 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:49 user nova-compute[75239]: FIRMWARE:
Nov 13 20:45:49 user nova-compute[75239]: No targets found.
Nov 13 20:45:49 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:45:49 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:45:49 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbbda3c-3c91-4e63-9b25-46870bf75c68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a19e283-8dc0-4a68-8593-0f9ce9052329]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:49 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:49 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:49 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d842fcee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db'): ({'sdg'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Removing single pathed devices sdg {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[322d2fdf-fc24-4a2e-802c-9c0762b24429]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa43b1f-a509-42d2-9aa0-f33c3607d251]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flushing IO for device /dev/sdg {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[254e7663-ac3f-42c9-8db3-cb7d1b78ad11]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.038s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b255fc-980a-416a-88f9-0a7053edad19]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] SCSI volumes sdg have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[10780d5d-8fba-4a71-a0db-132a3edb3fea]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba69e372-7baa-449d-8229-3b1e4cf59be1]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db, portal: 172.16.0.220,3260]
Nov 13 20:45:49 user nova-compute[75239]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:49 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1c8074-56da-4c04-b8dc-27016331f7db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e7c1c6-edc2-4a5f-b39d-70c03a1e1d46]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== disconnect_volume: return (362ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG nova.network.neutron [req-54426dea-7356-4af6-9ada-f4e1b6c6d3cb req-6ea0a456-89e4-4705-ad0c-466bb95e6cdd service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updated VIF entry in instance network info cache for port 0da27379-6537-4987-ad38-12e5e1d9f277. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG nova.network.neutron [req-54426dea-7356-4af6-9ada-f4e1b6c6d3cb req-6ea0a456-89e4-4705-ad0c-466bb95e6cdd service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updating instance_info_cache with network_info: [{"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-54426dea-7356-4af6-9ada-f4e1b6c6d3cb req-6ea0a456-89e4-4705-ad0c-466bb95e6cdd service nova] Releasing lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9d45a0c4-58bd-4776-9dcb-7ddfbf1e0276 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.828s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Stashing vm_state: active {{(pid=75239) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:45:50 user nova-compute[75239]: INFO nova.compute.claims [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Claim successful on node user
Nov 13 20:45:50 user nova-compute[75239]: INFO nova.compute.resource_tracker [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating resource usage from migration 9eeef0d5-e302-41ae-970c-86ce849091ca
Nov 13 20:45:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-c8da1d21-be1a-4baf-b423-beba12b2e300 req-b3007a86-fa86-4854-95d9-cbfd15de6a6e service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-changed-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-c8da1d21-be1a-4baf-b423-beba12b2e300 req-b3007a86-fa86-4854-95d9-cbfd15de6a6e service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Refreshing instance network info cache due to event network-changed-c81078b8-09c9-413f-8166-acd8fa285a00. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c8da1d21-be1a-4baf-b423-beba12b2e300 req-b3007a86-fa86-4854-95d9-cbfd15de6a6e service nova] Acquiring lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c8da1d21-be1a-4baf-b423-beba12b2e300 req-b3007a86-fa86-4854-95d9-cbfd15de6a6e service nova] Acquired lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:50 user nova-compute[75239]: DEBUG nova.network.neutron [req-c8da1d21-be1a-4baf-b423-beba12b2e300 req-b3007a86-fa86-4854-95d9-cbfd15de6a6e service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Refreshing network info cache for port c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:51 user nova-compute[75239]: INFO nova.compute.manager [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Detaching volume 998427ca-f3aa-40a0-9823-e8a7def3610e
Nov 13 20:45:51 user nova-compute[75239]: INFO nova.virt.block_device [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Attempting to driver detach volume 998427ca-f3aa-40a0-9823-e8a7def3610e from mountpoint /dev/vdc
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.network.neutron [req-c8da1d21-be1a-4baf-b423-beba12b2e300 req-b3007a86-fa86-4854-95d9-cbfd15de6a6e service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updated VIF entry in instance network info cache for port c81078b8-09c9-413f-8166-acd8fa285a00. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.network.neutron [req-c8da1d21-be1a-4baf-b423-beba12b2e300 req-b3007a86-fa86-4854-95d9-cbfd15de6a6e service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating instance_info_cache with network_info: [{"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c8da1d21-be1a-4baf-b423-beba12b2e300 req-b3007a86-fa86-4854-95d9-cbfd15de6a6e service nova] Releasing lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Attempting to detach device vdc from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:45:51 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:51 user nova-compute[75239]:   <source dev="/dev/sdh"/>
Nov 13 20:45:51 user nova-compute[75239]:   <target dev="vdc" bus="virtio"/>
Nov 13 20:45:51 user nova-compute[75239]:   <serial>998427ca-f3aa-40a0-9823-e8a7def3610e</serial>
Nov 13 20:45:51 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 20:45:51 user nova-compute[75239]: </disk>
Nov 13 20:45:51 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:45:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully detached device vdc from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e from the persistent domain config.
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:45:51 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:45:51 user nova-compute[75239]:   <source dev="/dev/sdh"/>
Nov 13 20:45:51 user nova-compute[75239]:   <target dev="vdc" bus="virtio"/>
Nov 13 20:45:51 user nova-compute[75239]:   <serial>998427ca-f3aa-40a0-9823-e8a7def3610e</serial>
Nov 13 20:45:51 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 20:45:51 user nova-compute[75239]: </disk>
Nov 13 20:45:51 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.690s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:51 user nova-compute[75239]: INFO nova.compute.manager [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Migrating
Nov 13 20:45:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquired lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.network.neutron [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.network.neutron [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating instance_info_cache with network_info: [{"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Releasing lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Starting migrate_disk_and_power_off {{(pid=75239) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-bd338453-7989-46d0-b289-5978193a2815 req-d9ebd4d1-411b-4750-a6ea-d87f0278cb3c service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-unplugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bd338453-7989-46d0-b289-5978193a2815 req-d9ebd4d1-411b-4750-a6ea-d87f0278cb3c service nova] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bd338453-7989-46d0-b289-5978193a2815 req-d9ebd4d1-411b-4750-a6ea-d87f0278cb3c service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bd338453-7989-46d0-b289-5978193a2815 req-d9ebd4d1-411b-4750-a6ea-d87f0278cb3c service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-bd338453-7989-46d0-b289-5978193a2815 req-d9ebd4d1-411b-4750-a6ea-d87f0278cb3c service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] No waiting events found dispatching network-vif-unplugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:52 user nova-compute[75239]: WARNING nova.compute.manager [req-bd338453-7989-46d0-b289-5978193a2815 req-d9ebd4d1-411b-4750-a6ea-d87f0278cb3c service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received unexpected event network-vif-unplugged-c81078b8-09c9-413f-8166-acd8fa285a00 for instance with vm_state active and task_state resize_migrating.
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Instance destroyed successfully.
Nov 13 20:45:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1277596519',display_name='tempest-ServerActionsTestOtherA-server-1277596519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1277596519',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx37q9vY0QYlo3fI5aFH9X6d2hNyPjTGXNNUmCr6ibGa/Kc1ClaPlhMidaIIsV7Y1igpikXwuCDpafpWPc5/9hzW0qq+/XK1xQPQ4kHZy5qMv84+zHN9XJn4hcGarD9Lw==',key_name='tempest-keypair-1127026760',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:44:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-qvsenhs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=e62931e3-90bb-4959-825c-e80dfc391989,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1390101111-network", "vif_mac": "fa:16:3e:3f:04:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1390101111-network", "vif_mac": "fa:16:3e:3f:04:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_vif [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc81078b8-09, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b937af3-a81e-4c94-ad57-ee0a34911e41) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:52 user nova-compute[75239]: INFO os_vif [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09')
Nov 13 20:45:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wORodVyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:52 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b467e83-697d-45b3-9efa-65a56a237f4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:45:52 user nova-compute[75239]: No targets found.
Nov 13 20:45:52 user nova-compute[75239]: iSNS:
Nov 13 20:45:52 user nova-compute[75239]: No targets found.
Nov 13 20:45:52 user nova-compute[75239]: STATIC:
Nov 13 20:45:52 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:45:52 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:52 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:52 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:45:52 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:52 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:52 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:45:52 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:52 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:52 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e
Nov 13 20:45:52 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:52 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:52 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6
Nov 13 20:45:52 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:52 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:52 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b
Nov 13 20:45:52 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:45:52 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:45:52 user nova-compute[75239]: FIRMWARE:
Nov 13 20:45:52 user nova-compute[75239]: No targets found.
Nov 13 20:45:52 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:45:52 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:45:52 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a99dc3-c336-4aa8-88e7-773d2d950f8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb687233-55ee-4151-ae6c-1882b54b52f0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:52 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:52 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:52 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d6050f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9'): ({'sde'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Removing single pathed devices sde {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2851cf-f95c-4cad-9112-99c7226c6abe]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb155122-a84e-416d-925d-a20f68e572e8]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flushing IO for device /dev/sde {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[48612cea-f2ed-4000-a355-edd445967761]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[980d5cb7-67a4-4ba1-a6df-535fe7175b6a]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fae9e6f-6d39-408b-921b-6948082967a8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c018ea6-a386-4b7f-872e-75e92e4b7680]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260]
Nov 13 20:45:53 user nova-compute[75239]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:53 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df65351-b73d-4adb-9628-89732dff528c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== disconnect_volume: return (340ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:45:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Port c81078b8-09c9-413f-8166-acd8fa285a00 binding to destination host user is already ACTIVE {{(pid=75239) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-f1fe6927-5e07-44ea-b310-b0f5e6c81c9b req-3d1c76ee-5316-4eaf-88ee-c1bd49a47746 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f1fe6927-5e07-44ea-b310-b0f5e6c81c9b req-3d1c76ee-5316-4eaf-88ee-c1bd49a47746 service nova] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f1fe6927-5e07-44ea-b310-b0f5e6c81c9b req-3d1c76ee-5316-4eaf-88ee-c1bd49a47746 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f1fe6927-5e07-44ea-b310-b0f5e6c81c9b req-3d1c76ee-5316-4eaf-88ee-c1bd49a47746 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-f1fe6927-5e07-44ea-b310-b0f5e6c81c9b req-3d1c76ee-5316-4eaf-88ee-c1bd49a47746 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] No waiting events found dispatching network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:54 user nova-compute[75239]: WARNING nova.compute.manager [req-f1fe6927-5e07-44ea-b310-b0f5e6c81c9b req-3d1c76ee-5316-4eaf-88ee-c1bd49a47746 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received unexpected event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 for instance with vm_state active and task_state resize_migrated.
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquired lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating instance_info_cache with network_info: [{"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Releasing lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG os_brick.utils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e20856-870a-4887-90dc-86545f4874fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[220e7cca-b60f-4d93-a09e-ce301a9add66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6923713-2c96-46cc-bb19-ad196dff8b11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b5e717-abbd-4199-8c58-f1a9f3c965e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:45:54 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:45:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[642a496d-22a4-44ab-9f2d-c2f37a5f98fa]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:45:54 user nova-compute[75239]: DEBUG os_brick.utils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:45:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:58 user nova-compute[75239]: INFO nova.compute.manager [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Rescuing
Nov 13 20:45:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:45:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquired lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:45:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Updating instance_info_cache with network_info: [{"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Releasing lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Starting finish_migration {{(pid=75239) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Instance directory exists: not creating {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 20:45:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Creating image(s)
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Ensure instance console log exists: /opt/stack/data/nova/instances/e62931e3-90bb-4959-825c-e80dfc391989/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Start _get_guest_xml network_info=[{"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1390101111-network", "vif_mac": "fa:16:3e:3f:04:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e908df1f-0d08-42d2-b24c-81f0b4f199d8', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wORodVyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'e62931e3-90bb-4959-825c-e80dfc391989', 'attached_at': '2023-11-13T20:45:59.000000', 'detached_at': '', 'volume_id': '3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'serial': '3a60d3dd-39ef-42d4-9c16-d13ccdea60c9'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:45:59 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:59 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wORodVyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:45:59 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:59 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:45:59 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dffb606-5b18-4e74-9657-66fee866916b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:45:59 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc55bc-3d09-43a0-8628-116160e22138]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9] added
Nov 13 20:45:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[156f7be1-979e-4507-871a-6ed2b9317676]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64c26f3-8d65-475a-8166-b3db585f3ee3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wORodVyS {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wORodVyS" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[907116c9-b5a6-4477-9b65-691e9aef627c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wORodVyS'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fb4b3d-cadb-4ffe-903e-1675d0d8e288]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aade4720-c033-4373-8bc8-b34661cd1641]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-6f9a89e0-56ae-4291-b4d2-34c554f0a9ff req-e16fb587-4754-4d45-bf9b-0a723c606cb8 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-unplugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6f9a89e0-56ae-4291-b4d2-34c554f0a9ff req-e16fb587-4754-4d45-bf9b-0a723c606cb8 service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6f9a89e0-56ae-4291-b4d2-34c554f0a9ff req-e16fb587-4754-4d45-bf9b-0a723c606cb8 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6f9a89e0-56ae-4291-b4d2-34c554f0a9ff req-e16fb587-4754-4d45-bf9b-0a723c606cb8 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-6f9a89e0-56ae-4291-b4d2-34c554f0a9ff req-e16fb587-4754-4d45-bf9b-0a723c606cb8 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-unplugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:45:59 user nova-compute[75239]: WARNING nova.compute.manager [req-6f9a89e0-56ae-4291-b4d2-34c554f0a9ff req-e16fb587-4754-4d45-bf9b-0a723c606cb8 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-unplugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state active and task_state rescuing.
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e384cf5e-a53b-42c4-8cbe-212b021d71b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260]
Nov 13 20:45:59 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260] successful.
Nov 13 20:45:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8813aa64-a3d5-4d5e-8b4b-6023d9b84b70]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[00406032-6cb6-4a27-adab-c232fdd59245]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:45:59 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:45:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d4c1c1-9cab-4593-b724-3d93222fe187]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wORodVyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:45:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:45:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Instance destroyed successfully.
Nov 13 20:45:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Attempting a stable device rescue
Nov 13 20:45:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 20:46:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Instance directory exists: not creating {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 20:46:00 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Creating image(s)
Nov 13 20:46:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "/opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "/opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:00 user nova-compute[75239]: DEBUG nova.objects.instance [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "50e87d38af29550d7ca96cdfce4778ab1dd8c4a8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "50e87d38af29550d7ca96cdfce4778ab1dd8c4a8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.962s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== connect_volume: return (1964ms) {'type': 'block', 'scsi_wwn': '26533633130373631', 'path': '/dev/sdd'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533633130373631', 'path': '/dev/sdd'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1277596519',display_name='tempest-ServerActionsTestOtherA-server-1277596519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1277596519',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx37q9vY0QYlo3fI5aFH9X6d2hNyPjTGXNNUmCr6ibGa/Kc1ClaPlhMidaIIsV7Y1igpikXwuCDpafpWPc5/9hzW0qq+/XK1xQPQ4kHZy5qMv84+zHN9XJn4hcGarD9Lw==',key_name='tempest-keypair-1127026760',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:44:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-qvsenhs8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:45:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=e62931e3-90bb-4959-825c-e80dfc391989,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1390101111-network", "vif_mac": "fa:16:3e:3f:04:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1390101111-network", "vif_mac": "fa:16:3e:3f:04:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:46:01 user nova-compute[75239]:   <uuid>e62931e3-90bb-4959-825c-e80dfc391989</uuid>
Nov 13 20:46:01 user nova-compute[75239]:   <name>instance-0000001e</name>
Nov 13 20:46:01 user nova-compute[75239]:   <memory>2097152</memory>
Nov 13 20:46:01 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:46:01 user nova-compute[75239]:   <metadata>
Nov 13 20:46:01 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:46:01 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:46:01 user nova-compute[75239]:       <nova:name>tempest-ServerActionsTestOtherA-server-1277596519</nova:name>
Nov 13 20:46:01 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:45:59</nova:creationTime>
Nov 13 20:46:01 user nova-compute[75239]:       <nova:flavor name="m1.small">
Nov 13 20:46:01 user nova-compute[75239]:         <nova:memory>2048</nova:memory>
Nov 13 20:46:01 user nova-compute[75239]:         <nova:disk>20</nova:disk>
Nov 13 20:46:01 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:46:01 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:46:01 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:46:01 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:46:01 user nova-compute[75239]:       <nova:owner>
Nov 13 20:46:01 user nova-compute[75239]:         <nova:user uuid="3d8ae2d158f94548bc3d9873317935cd">tempest-ServerActionsTestOtherA-1210141142-project-member</nova:user>
Nov 13 20:46:01 user nova-compute[75239]:         <nova:project uuid="e14ce616b1ad4ee7934e34bad1fdf6a3">tempest-ServerActionsTestOtherA-1210141142</nova:project>
Nov 13 20:46:01 user nova-compute[75239]:       </nova:owner>
Nov 13 20:46:01 user nova-compute[75239]:       <nova:ports>
Nov 13 20:46:01 user nova-compute[75239]:         <nova:port uuid="c81078b8-09c9-413f-8166-acd8fa285a00">
Nov 13 20:46:01 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:46:01 user nova-compute[75239]:         </nova:port>
Nov 13 20:46:01 user nova-compute[75239]:       </nova:ports>
Nov 13 20:46:01 user nova-compute[75239]:     </nova:instance>
Nov 13 20:46:01 user nova-compute[75239]:   </metadata>
Nov 13 20:46:01 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:46:01 user nova-compute[75239]:     <system>
Nov 13 20:46:01 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:46:01 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:46:01 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:46:01 user nova-compute[75239]:       <entry name="serial">e62931e3-90bb-4959-825c-e80dfc391989</entry>
Nov 13 20:46:01 user nova-compute[75239]:       <entry name="uuid">e62931e3-90bb-4959-825c-e80dfc391989</entry>
Nov 13 20:46:01 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:46:01 user nova-compute[75239]:     </system>
Nov 13 20:46:01 user nova-compute[75239]:   </sysinfo>
Nov 13 20:46:01 user nova-compute[75239]:   <os>
Nov 13 20:46:01 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:46:01 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:46:01 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:46:01 user nova-compute[75239]:   </os>
Nov 13 20:46:01 user nova-compute[75239]:   <features>
Nov 13 20:46:01 user nova-compute[75239]:     <acpi/>
Nov 13 20:46:01 user nova-compute[75239]:     <apic/>
Nov 13 20:46:01 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:46:01 user nova-compute[75239]:   </features>
Nov 13 20:46:01 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:46:01 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:46:01 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:46:01 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:46:01 user nova-compute[75239]:   </clock>
Nov 13 20:46:01 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:46:01 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:46:01 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:46:01 user nova-compute[75239]:   </cpu>
Nov 13 20:46:01 user nova-compute[75239]:   <devices>
Nov 13 20:46:01 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:46:01 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:46:01 user nova-compute[75239]:       <source dev="/dev/sdd"/>
Nov 13 20:46:01 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:46:01 user nova-compute[75239]:       <serial>3a60d3dd-39ef-42d4-9c16-d13ccdea60c9</serial>
Nov 13 20:46:01 user nova-compute[75239]:     </disk>
Nov 13 20:46:01 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:46:01 user nova-compute[75239]:       <mac address="fa:16:3e:3f:04:f5"/>
Nov 13 20:46:01 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:46:01 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:46:01 user nova-compute[75239]:       <target dev="tapc81078b8-09"/>
Nov 13 20:46:01 user nova-compute[75239]:     </interface>
Nov 13 20:46:01 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:46:01 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/e62931e3-90bb-4959-825c-e80dfc391989/console.log" append="off"/>
Nov 13 20:46:01 user nova-compute[75239]:     </serial>
Nov 13 20:46:01 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:46:01 user nova-compute[75239]:     <video>
Nov 13 20:46:01 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:46:01 user nova-compute[75239]:     </video>
Nov 13 20:46:01 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:46:01 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:46:01 user nova-compute[75239]:     </rng>
Nov 13 20:46:01 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:46:01 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:46:01 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:46:01 user nova-compute[75239]:     </memballoon>
Nov 13 20:46:01 user nova-compute[75239]:   </devices>
Nov 13 20:46:01 user nova-compute[75239]: </domain>
Nov 13 20:46:01 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1277596519',display_name='tempest-ServerActionsTestOtherA-server-1277596519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1277596519',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx37q9vY0QYlo3fI5aFH9X6d2hNyPjTGXNNUmCr6ibGa/Kc1ClaPlhMidaIIsV7Y1igpikXwuCDpafpWPc5/9hzW0qq+/XK1xQPQ4kHZy5qMv84+zHN9XJn4hcGarD9Lw==',key_name='tempest-keypair-1127026760',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:44:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-qvsenhs8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:45:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=e62931e3-90bb-4959-825c-e80dfc391989,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1390101111-network", "vif_mac": "fa:16:3e:3f:04:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1390101111-network", "vif_mac": "fa:16:3e:3f:04:f5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG os_vif [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd0c2aa5-21bc-5c68-8f7a-a3d388b383e1', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc81078b8-09, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc81078b8-09, col_values=(('qos', UUID('48bd359b-8935-4747-884a-e23242ab924e')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc81078b8-09, col_values=(('external_ids', {'iface-id': 'c81078b8-09c9-413f-8166-acd8fa285a00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:04:f5', 'vm-uuid': 'e62931e3-90bb-4959-825c-e80dfc391989'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:01 user nova-compute[75239]: INFO os_vif [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09')
Nov 13 20:46:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8.part --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.virt.images [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] e297ce5b-46e6-4447-93c6-4b4e072ada65 was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8.part /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] No VIF found with MAC fa:16:3e:3f:04:f5, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-e3de0edd-2bed-418b-b2cd-57bcd47baf50 req-cf9ac82c-740d-4396-bbe7-5bdecc6eef09 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e3de0edd-2bed-418b-b2cd-57bcd47baf50 req-cf9ac82c-740d-4396-bbe7-5bdecc6eef09 service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e3de0edd-2bed-418b-b2cd-57bcd47baf50 req-cf9ac82c-740d-4396-bbe7-5bdecc6eef09 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e3de0edd-2bed-418b-b2cd-57bcd47baf50 req-cf9ac82c-740d-4396-bbe7-5bdecc6eef09 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-e3de0edd-2bed-418b-b2cd-57bcd47baf50 req-cf9ac82c-740d-4396-bbe7-5bdecc6eef09 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:01 user nova-compute[75239]: WARNING nova.compute.manager [req-e3de0edd-2bed-418b-b2cd-57bcd47baf50 req-cf9ac82c-740d-4396-bbe7-5bdecc6eef09 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state active and task_state rescuing.
Nov 13 20:46:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8.part /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8.converted" returned: 0 in 0.561s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "50e87d38af29550d7ca96cdfce4778ab1dd8c4a8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.065s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "50e87d38af29550d7ca96cdfce4778ab1dd8c4a8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "50e87d38af29550d7ca96cdfce4778ab1dd8c4a8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8 --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8,backing_fmt=raw /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8,backing_fmt=raw /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue" returned: 0 in 0.051s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "50e87d38af29550d7ca96cdfce4778ab1dd8c4a8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'migration_context' on Instance uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<0ba53275-7df4-4ecf-a4cc-860975b83d5f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Start _get_guest_xml network_info=[{"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "vif_mac": "fa:16:3e:86:2f:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e297ce5b-46e6-4447-93c6-4b4e072ada65', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f7fe4868-00ae-45da-9ce2-11ef762cfd58', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxrEQtas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0ba53275-7df4-4ecf-a4cc-860975b83d5f', 'attached_at': '', 'detached_at': '', 'volume_id': '78bb4404-70be-4898-aae4-a63902fa601d', 'serial': '78bb4404-70be-4898-aae4-a63902fa601d'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'resources' on Instance uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<0ba53275-7df4-4ecf-a4cc-860975b83d5f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'numa_topology' on Instance uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<0ba53275-7df4-4ecf-a4cc-860975b83d5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:46:02 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:46:02 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<0ba53275-7df4-4ecf-a4cc-860975b83d5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxrEQtas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:46:02 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:46:02 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:46:02 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9020e761-7c61-4cd6-a7f3-6581f38c390f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = SxrEQtas\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 20:46:02 user nova-compute[75239]: node.name = iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:46:02 user nova-compute[75239]: node.tpgt = -1
Nov 13 20:46:02 user nova-compute[75239]: node.startup = automatic
Nov 13 20:46:02 user nova-compute[75239]: node.leading_login = No
Nov 13 20:46:02 user nova-compute[75239]: iface.iscsi_ifacename = default
Nov 13 20:46:02 user nova-compute[75239]: iface.net_ifacename = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.ipaddress = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.prefix_len = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.hwaddress = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.transport_name = tcp
Nov 13 20:46:02 user nova-compute[75239]: iface.initiatorname = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.state = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.vlan_id = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.vlan_priority = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.vlan_state = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.iface_num = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.mtu = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.port = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.bootproto = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.subnet_mask = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.gateway = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.dhcp_alt_client_id = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.dhcp_dns = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.dhcp_learn_iqn = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.dhcp_vendor_id_state = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.dhcp_vendor_id = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.dhcp_slp_da = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.fragmentation = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.gratuitous_arp = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.incoming_forwarding = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.tos_state = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.tos = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.ttl = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.delayed_ack = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.tcp_nagle = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.tcp_wsf_state = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.tcp_wsf = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.tcp_timer_scale = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.tcp_timestamp = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.redirect = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.def_task_mgmt_timeout = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.header_digest = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.data_digest = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.immediate_data = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.initial_r2t = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.data_seq_inorder = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.data_pdu_inorder = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.erl = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.max_receive_data_len = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.first_burst_len = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.max_outstanding_r2t = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.max_burst_len = 0
Nov 13 20:46:02 user nova-compute[75239]: iface.chap_auth = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.bidi_chap = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.strict_login_compliance = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.discovery_auth = <empty>
Nov 13 20:46:02 user nova-compute[75239]: iface.discovery_logout = <empty>
Nov 13 20:46:02 user nova-compute[75239]: node.discovery_address = <empty>
Nov 13 20:46:02 user nova-compute[75239]: node.discovery_port = 0
Nov 13 20:46:02 user nova-compute[75239]: node.discovery_type = static
Nov 13 20:46:02 user nova-compute[75239]: node.session.initial_cmdsn = 0
Nov 13 20:46:02 user nova-compute[75239]: node.session.initial_login_retry_max = 8
Nov 13 20:46:02 user nova-compute[75239]: node.session.xmit_thread_priority = -20
Nov 13 20:46:02 user nova-compute[75239]: node.session.cmds_max = 128
Nov 13 20:46:02 user nova-compute[75239]: node.session.queue_depth = 32
Nov 13 20:46:02 user nova-compute[75239]: node.session.nr_sessions = 1
Nov 13 20:46:02 user nova-compute[75239]: node.session.auth.authmethod = CHAP
Nov 13 20:46:02 user nova-compute[75239]: node.session.auth.username = SxrEQtas
Nov 13 20:46:02 user nova-compute[75239]: node.session.auth.password = ***
Nov 13 20:46:02 user nova-compute[75239]: node.session.auth.username_in = <empty>
Nov 13 20:46:02 user nova-compute[75239]: node.session.auth.password_in = <empty>
Nov 13 20:46:02 user nova-compute[75239]: node.session.auth.chap_algs = MD5
Nov 13 20:46:02 user nova-compute[75239]: node.session.timeo.replacement_timeout = 120
Nov 13 20:46:02 user nova-compute[75239]: node.session.err_timeo.abort_timeout = 15
Nov 13 20:46:02 user nova-compute[75239]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 20:46:02 user nova-compute[75239]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 20:46:02 user nova-compute[75239]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.FastAbort = Yes
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.InitialR2T = No
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.ImmediateData = Yes
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.MaxConnections = 1
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 20:46:02 user nova-compute[75239]: node.session.iscsi.ERL = 0
Nov 13 20:46:02 user nova-compute[75239]: node.session.scan = manual
Nov 13 20:46:02 user nova-compute[75239]: node.session.reopen_max = 0
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].address = 172.16.0.220
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].port = 3260
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].startup = manual
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].tcp.window_size = 524288
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].tcp.type_of_service = 0
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].timeo.logout_timeout = 15
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].timeo.login_timeout = 15
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].timeo.auth_timeout = 45
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].iscsi.DataDigest = None
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].iscsi.IFMarker = No
Nov 13 20:46:02 user nova-compute[75239]: node.conn[0].iscsi.OFMarker = No
Nov 13 20:46:02 user nova-compute[75239]: # END RECORD
Nov 13 20:46:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3bba11-1a97-4ac4-a596-a4bd3577a2e4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e32eb4-89a1-412b-be1e-294b167b1c81]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxrEQtas {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SxrEQtas" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6945275-8ffa-4a4f-8c47-dda66a3b200e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SxrEQtas'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fdd77c-8af8-4f73-8781-8ee3f991879a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f51731-746f-480f-bd46-fe05d097c476]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:46:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:46:02 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:46:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] HCTL ('37', '0', '0', 0) found on session 35 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60af208-b179-4ee1-9d0d-0d10b75f107e]: (4, ('0 0 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Searching for a device in session 35 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxrEQtas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.169s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '23038396637643961', 'path': '/dev/sdf'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038396637643961', 'path': '/dev/sdf'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:44:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1592386908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1592386908',id=31,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:44:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-5jmj3d54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:44:24Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=0ba53275-7df4-4ecf-a4cc-860975b83d5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "vif_mac": "fa:16:3e:86:2f:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "vif_mac": "fa:16:3e:86:2f:80"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:2f:80,bridge_name='br-int',has_traffic_filtering=True,id=26feda94-26fa-4eda-b66a-0d3402158d5b,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26feda94-26') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.objects.base [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Object Instance<0ba53275-7df4-4ecf-a4cc-860975b83d5f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:46:02 user nova-compute[75239]:   <uuid>0ba53275-7df4-4ecf-a4cc-860975b83d5f</uuid>
Nov 13 20:46:02 user nova-compute[75239]:   <name>instance-0000001f</name>
Nov 13 20:46:02 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:46:02 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:46:02 user nova-compute[75239]:   <metadata>
Nov 13 20:46:02 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:46:02 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:46:02 user nova-compute[75239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1592386908</nova:name>
Nov 13 20:46:02 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:46:02</nova:creationTime>
Nov 13 20:46:02 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:46:02 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:46:02 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:46:02 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:46:02 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:46:02 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:46:02 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:46:02 user nova-compute[75239]:       <nova:owner>
Nov 13 20:46:02 user nova-compute[75239]:         <nova:user uuid="2669d647fe6f4034bc70703546345eb3">tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member</nova:user>
Nov 13 20:46:02 user nova-compute[75239]:         <nova:project uuid="f465510aec2849dfb0917120a772f066">tempest-ServerBootFromVolumeStableRescueTest-2033691872</nova:project>
Nov 13 20:46:02 user nova-compute[75239]:       </nova:owner>
Nov 13 20:46:02 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:46:02 user nova-compute[75239]:       <nova:ports>
Nov 13 20:46:02 user nova-compute[75239]:         <nova:port uuid="26feda94-26fa-4eda-b66a-0d3402158d5b">
Nov 13 20:46:02 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 20:46:02 user nova-compute[75239]:         </nova:port>
Nov 13 20:46:02 user nova-compute[75239]:       </nova:ports>
Nov 13 20:46:02 user nova-compute[75239]:     </nova:instance>
Nov 13 20:46:02 user nova-compute[75239]:   </metadata>
Nov 13 20:46:02 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:46:02 user nova-compute[75239]:     <system>
Nov 13 20:46:02 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:46:02 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:46:02 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:46:02 user nova-compute[75239]:       <entry name="serial">0ba53275-7df4-4ecf-a4cc-860975b83d5f</entry>
Nov 13 20:46:02 user nova-compute[75239]:       <entry name="uuid">0ba53275-7df4-4ecf-a4cc-860975b83d5f</entry>
Nov 13 20:46:02 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:46:02 user nova-compute[75239]:     </system>
Nov 13 20:46:02 user nova-compute[75239]:   </sysinfo>
Nov 13 20:46:02 user nova-compute[75239]:   <os>
Nov 13 20:46:02 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:46:02 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:46:02 user nova-compute[75239]:   </os>
Nov 13 20:46:02 user nova-compute[75239]:   <features>
Nov 13 20:46:02 user nova-compute[75239]:     <acpi/>
Nov 13 20:46:02 user nova-compute[75239]:     <apic/>
Nov 13 20:46:02 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:46:02 user nova-compute[75239]:   </features>
Nov 13 20:46:02 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:46:02 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:46:02 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:46:02 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:46:02 user nova-compute[75239]:   </clock>
Nov 13 20:46:02 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:46:02 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:46:02 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:46:02 user nova-compute[75239]:   </cpu>
Nov 13 20:46:02 user nova-compute[75239]:   <devices>
Nov 13 20:46:02 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:46:02 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:46:02 user nova-compute[75239]:       <source dev="/dev/sdf"/>
Nov 13 20:46:02 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:46:02 user nova-compute[75239]:       <serial>78bb4404-70be-4898-aae4-a63902fa601d</serial>
Nov 13 20:46:02 user nova-compute[75239]:     </disk>
Nov 13 20:46:02 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:46:02 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:46:02 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue"/>
Nov 13 20:46:02 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:46:02 user nova-compute[75239]:       <boot order="1"/>
Nov 13 20:46:02 user nova-compute[75239]:     </disk>
Nov 13 20:46:02 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:46:02 user nova-compute[75239]:       <mac address="fa:16:3e:86:2f:80"/>
Nov 13 20:46:02 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:46:02 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:46:02 user nova-compute[75239]:       <target dev="tap26feda94-26"/>
Nov 13 20:46:02 user nova-compute[75239]:     </interface>
Nov 13 20:46:02 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:46:02 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/console.log" append="off"/>
Nov 13 20:46:02 user nova-compute[75239]:     </serial>
Nov 13 20:46:02 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:46:02 user nova-compute[75239]:     <video>
Nov 13 20:46:02 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:46:02 user nova-compute[75239]:     </video>
Nov 13 20:46:02 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:46:02 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:46:02 user nova-compute[75239]:     </rng>
Nov 13 20:46:02 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:46:02 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:46:02 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:46:02 user nova-compute[75239]:     </memballoon>
Nov 13 20:46:02 user nova-compute[75239]:   </devices>
Nov 13 20:46:02 user nova-compute[75239]: </domain>
Nov 13 20:46:02 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:46:02 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Instance destroyed successfully.
Nov 13 20:46:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] No VIF found with MAC fa:16:3e:86:2f:80, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] No waiting events found dispatching network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:03 user nova-compute[75239]: WARNING nova.compute.manager [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received unexpected event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 for instance with vm_state active and task_state resize_finish.
Nov 13 20:46:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] No waiting events found dispatching network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:03 user nova-compute[75239]: WARNING nova.compute.manager [req-b903541f-1077-4b08-8359-eac059870376 req-07460ef6-0c71-45ed-a54f-2f1b952ded4c service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received unexpected event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 for instance with vm_state active and task_state resize_finish.
Nov 13 20:46:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:05 user nova-compute[75239]: WARNING nova.compute.manager [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state active and task_state rescuing.
Nov 13 20:46:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:05 user nova-compute[75239]: WARNING nova.compute.manager [req-1239fe46-70d8-4f1e-9735-d5f58ac6d541 req-823dcc06-9dd9-441e-a9b2-d9945e425bc1 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state active and task_state rescuing.
Nov 13 20:46:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:46:05 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Instance running successfully.
Nov 13 20:46:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Failed to set time: agent not configured {{(pid=75239) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 20:46:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-26eace5a-ea4a-4622-a0d0-1d4f3d4f1842 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] finish_migration finished successfully. {{(pid=75239) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 20:46:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-38457e49-d81e-43ba-8a17-d68db19707a6 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:07 user nova-compute[75239]: INFO nova.compute.manager [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Terminating instance
Nov 13 20:46:07 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-85890587-3b0c-42dd-abec-3c06ea539826 req-d5875f12-8c6a-4f5b-aa59-96084f10aaea service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-unplugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-85890587-3b0c-42dd-abec-3c06ea539826 req-d5875f12-8c6a-4f5b-aa59-96084f10aaea service nova] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-85890587-3b0c-42dd-abec-3c06ea539826 req-d5875f12-8c6a-4f5b-aa59-96084f10aaea service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-85890587-3b0c-42dd-abec-3c06ea539826 req-d5875f12-8c6a-4f5b-aa59-96084f10aaea service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-85890587-3b0c-42dd-abec-3c06ea539826 req-d5875f12-8c6a-4f5b-aa59-96084f10aaea service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] No waiting events found dispatching network-vif-unplugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-85890587-3b0c-42dd-abec-3c06ea539826 req-d5875f12-8c6a-4f5b-aa59-96084f10aaea service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-unplugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Instance destroyed successfully.
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.objects.instance [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'resources' on Instance uuid ac9ac0ae-2f54-4130-aefa-17e7d36a5621 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-449964227',display_name='tempest-TestMinimumBasicScenario-server-449964227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-449964227',id=25,image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBp/zymYPzrC2cq/ApuPEOrcNJO47mKCagQFITBK4Xp20X9/7JqHfiUue4O7ur0brcNWAVqhJ6uBAft/viDg76a6W2C7ikxLv/XhEx5XTImMpMM/zOG1KHdX6M5OEb7AzQ==',key_name='tempest-TestMinimumBasicScenario-1764874526',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:41:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53fd8f58057142af8d76c28d6b7b70c6',ramdisk_id='',reservation_id='r-4exsmb4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8b0c7e2a-f1d7-414a-9bb2-4120ee884b26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-168427819',owner_user_name='tempest-TestMinimumBasicScenario-168427819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:43:31Z,user_data=None,user_id='6abaa983d703498f9bcd47764794423c',uuid=ac9ac0ae-2f54-4130-aefa-17e7d36a5621,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converting VIF {"id": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "address": "fa:16:3e:b3:7c:48", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5265dee-cd", "ovs_interfaceid": "f5265dee-cd51-48a3-8c95-5b0b70e90e1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG os_vif [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5265dee-cd, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=558a81e2-7bea-4e53-914a-f5ebfbceadd4) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:08 user nova-compute[75239]: INFO os_vif [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:7c:48,bridge_name='br-int',has_traffic_filtering=True,id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5265dee-cd')
Nov 13 20:46:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Deleting instance files /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621_del
Nov 13 20:46:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Deletion of /opt/stack/data/nova/instances/ac9ac0ae-2f54-4130-aefa-17e7d36a5621_del complete
Nov 13 20:46:08 user nova-compute[75239]: INFO nova.compute.manager [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 20:46:08 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:46:08 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Took 0.48 seconds to deallocate network for instance.
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-39aa56da-1033-45a8-b38b-5b1168a41436 req-270c9a7c-2077-412a-ad9e-16f20b627419 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-deleted-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:08 user nova-compute[75239]: INFO nova.compute.manager [req-39aa56da-1033-45a8-b38b-5b1168a41436 req-270c9a7c-2077-412a-ad9e-16f20b627419 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Neutron deleted interface f5265dee-cd51-48a3-8c95-5b0b70e90e1f; detaching it from the instance and deleting it from the info cache
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.network.neutron [req-39aa56da-1033-45a8-b38b-5b1168a41436 req-270c9a7c-2077-412a-ad9e-16f20b627419 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-39aa56da-1033-45a8-b38b-5b1168a41436 req-270c9a7c-2077-412a-ad9e-16f20b627419 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Detach interface failed, port_id=f5265dee-cd51-48a3-8c95-5b0b70e90e1f, reason: Instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:09 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:46:09 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:46:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:09 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Deleted allocations for instance ac9ac0ae-2f54-4130-aefa-17e7d36a5621
Nov 13 20:46:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c9ae1cdd-b1a4-45d2-8ef9-0530e2892d47 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.086s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-db75e2e3-f849-4785-9da4-f237e79ecbee req-c8eb2465-0a80-4dc0-805b-f163f2396d37 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-db75e2e3-f849-4785-9da4-f237e79ecbee req-c8eb2465-0a80-4dc0-805b-f163f2396d37 service nova] Acquiring lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-db75e2e3-f849-4785-9da4-f237e79ecbee req-c8eb2465-0a80-4dc0-805b-f163f2396d37 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-db75e2e3-f849-4785-9da4-f237e79ecbee req-c8eb2465-0a80-4dc0-805b-f163f2396d37 service nova] Lock "ac9ac0ae-2f54-4130-aefa-17e7d36a5621-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-db75e2e3-f849-4785-9da4-f237e79ecbee req-c8eb2465-0a80-4dc0-805b-f163f2396d37 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] No waiting events found dispatching network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:09 user nova-compute[75239]: WARNING nova.compute.manager [req-db75e2e3-f849-4785-9da4-f237e79ecbee req-c8eb2465-0a80-4dc0-805b-f163f2396d37 service nova] [instance: ac9ac0ae-2f54-4130-aefa-17e7d36a5621] Received unexpected event network-vif-plugged-f5265dee-cd51-48a3-8c95-5b0b70e90e1f for instance with vm_state deleted and task_state None.
Nov 13 20:46:11 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e is timed out.
Nov 13 20:46:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully detached device vdc from instance 40d7bf6c-7117-431d-9223-8b7068f58d4e from the live domain config.
Nov 13 20:46:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YMhKxXtb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:46:12 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[402be00e-4cd7-42d8-9b0a-a02eb4de8753]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:46:12 user nova-compute[75239]: No targets found.
Nov 13 20:46:12 user nova-compute[75239]: iSNS:
Nov 13 20:46:12 user nova-compute[75239]: No targets found.
Nov 13 20:46:12 user nova-compute[75239]: STATIC:
Nov 13 20:46:12 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:46:12 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:46:12 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:46:12 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:46:12 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:46:12 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:46:12 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:46:12 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:46:12 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:46:12 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e
Nov 13 20:46:12 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:46:12 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:46:12 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6
Nov 13 20:46:12 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:46:12 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:46:12 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b
Nov 13 20:46:12 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:46:12 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:46:12 user nova-compute[75239]: FIRMWARE:
Nov 13 20:46:12 user nova-compute[75239]: No targets found.
Nov 13 20:46:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:46:12 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:46:12 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d5189-9d62-4247-ad0a-0f309bd8de9f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea835f3-0db4-4ae5-b447-725d4e2c4e9e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:46:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:46:12 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:46:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8424fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e'): ({'sdh'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Removing single pathed devices sdh {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15fffff-b5da-493f-9fa7-1e5bc7a28fed]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06e5e17-189d-42f7-a303-c48786f50478]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Flushing IO for device /dev/sdh {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb66c0-fb29-4af5-a40d-6b73c7513278]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7808802-5d39-45df-b6aa-ea2e2fdc0844]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] SCSI volumes sdh have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[367a3da9-15e5-42d0-bed6-0023d6bcda65]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37afa99-6940-47ae-8fcf-6ffff450581a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e, portal: 172.16.0.220,3260]
Nov 13 20:46:12 user nova-compute[75239]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e, portal: 172.16.0.220,3260] successful.
Nov 13 20:46:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998427ca-f3aa-40a0-9823-e8a7def3610e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1f4873-0fcb-4cc7-9b04-3c805c6f1e64]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] <== disconnect_volume: return (323ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:46:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:46:13 user nova-compute[75239]: DEBUG nova.objects.instance [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'flavor' on Instance uuid 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-44656cb8-a1dd-4612-9f98-2aed0216d94d tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:14 user nova-compute[75239]: INFO nova.compute.manager [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Terminating instance
Nov 13 20:46:14 user nova-compute[75239]: DEBUG nova.compute.manager [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-af677a30-5454-4dc3-b5e5-49b8b85bc564 req-042cc1f7-a78b-448b-821e-9151793008d9 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-unplugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-af677a30-5454-4dc3-b5e5-49b8b85bc564 req-042cc1f7-a78b-448b-821e-9151793008d9 service nova] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-af677a30-5454-4dc3-b5e5-49b8b85bc564 req-042cc1f7-a78b-448b-821e-9151793008d9 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-af677a30-5454-4dc3-b5e5-49b8b85bc564 req-042cc1f7-a78b-448b-821e-9151793008d9 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-af677a30-5454-4dc3-b5e5-49b8b85bc564 req-042cc1f7-a78b-448b-821e-9151793008d9 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] No waiting events found dispatching network-vif-unplugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-af677a30-5454-4dc3-b5e5-49b8b85bc564 req-042cc1f7-a78b-448b-821e-9151793008d9 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-unplugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Instance destroyed successfully.
Nov 13 20:46:15 user nova-compute[75239]: DEBUG nova.objects.instance [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lazy-loading 'resources' on Instance uuid 40d7bf6c-7117-431d-9223-8b7068f58d4e {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:43:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-671376649',display_name='tempest-AttachVolumeTestJSON-server-671376649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-671376649',id=29,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbYphv0kCriXhVyiAjlkXG1lXrfEo2VkfVBaiK5vz0ZPP11gVz79i5tE7J2jhhf4JxSF4KgwRtTNf7DdKbpDqvkTy/ht9Hg0FYyi3m5FagA2dTyInteWFKsMPQm5yYslg==',key_name='tempest-keypair-2079922746',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:43:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0a86eedbea84af3a57a6a4b266c06d4',ramdisk_id='',reservation_id='r-nke46j0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-2111443236',owner_user_name='tempest-AttachVolumeTestJSON-2111443236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:43:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1fa0bf5a26e4844a22d48ce70d8dc0a',uuid=40d7bf6c-7117-431d-9223-8b7068f58d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converting VIF {"id": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "address": "fa:16:3e:07:d6:c8", "network": {"id": "31a387ec-8b03-42fc-af85-72040445422d", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-822523394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0a86eedbea84af3a57a6a4b266c06d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdae63bc6-ac", "ovs_interfaceid": "dae63bc6-ac2b-45d5-a433-c8135bac7740", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:d6:c8,bridge_name='br-int',has_traffic_filtering=True,id=dae63bc6-ac2b-45d5-a433-c8135bac7740,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae63bc6-ac') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG os_vif [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:d6:c8,bridge_name='br-int',has_traffic_filtering=True,id=dae63bc6-ac2b-45d5-a433-c8135bac7740,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae63bc6-ac') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdae63bc6-ac, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f0b97ac1-a40a-48d1-ab17-240eb042f240) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: INFO os_vif [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:d6:c8,bridge_name='br-int',has_traffic_filtering=True,id=dae63bc6-ac2b-45d5-a433-c8135bac7740,network=Network(31a387ec-8b03-42fc-af85-72040445422d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdae63bc6-ac')
Nov 13 20:46:15 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Deleting instance files /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e_del
Nov 13 20:46:15 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Deletion of /opt/stack/data/nova/instances/40d7bf6c-7117-431d-9223-8b7068f58d4e_del complete
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: INFO nova.compute.manager [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 20:46:15 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:46:16 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Took 1.30 seconds to deallocate network for instance.
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] No waiting events found dispatching network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:16 user nova-compute[75239]: WARNING nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received unexpected event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 for instance with vm_state deleted and task_state None.
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] No waiting events found dispatching network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:16 user nova-compute[75239]: WARNING nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received unexpected event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 for instance with vm_state deleted and task_state None.
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] No waiting events found dispatching network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:16 user nova-compute[75239]: WARNING nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received unexpected event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 for instance with vm_state deleted and task_state None.
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-unplugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] No waiting events found dispatching network-vif-unplugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:16 user nova-compute[75239]: WARNING nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received unexpected event network-vif-unplugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 for instance with vm_state deleted and task_state None.
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Acquiring lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] No waiting events found dispatching network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:16 user nova-compute[75239]: WARNING nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received unexpected event network-vif-plugged-dae63bc6-ac2b-45d5-a433-c8135bac7740 for instance with vm_state deleted and task_state None.
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-b1fe8e71-4477-47c5-9f42-b89730010caa req-60db3657-5138-4911-99cb-d636f8061e82 service nova] [instance: 40d7bf6c-7117-431d-9223-8b7068f58d4e] Received event network-vif-deleted-dae63bc6-ac2b-45d5-a433-c8135bac7740 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:46:16 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:46:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:17 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Deleted allocations for instance 40d7bf6c-7117-431d-9223-8b7068f58d4e
Nov 13 20:46:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-258d63a1-4d21-4168-a41d-4bc777504d72 tempest-AttachVolumeTestJSON-2111443236 tempest-AttachVolumeTestJSON-2111443236-project-member] Lock "40d7bf6c-7117-431d-9223-8b7068f58d4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.774s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:46:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:37 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:46:37 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7379MB free_disk=24.732398986816406GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Applying migration context for instance e62931e3-90bb-4959-825c-e80dfc391989 as it has an incoming, in-progress migration 9eeef0d5-e302-41ae-970c-86ce849091ca. Migration status is finished {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 20:46:37 user nova-compute[75239]: INFO nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating resource usage from migration 9eeef0d5-e302-41ae-970c-86ce849091ca
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 0ba53275-7df4-4ecf-a4cc-860975b83d5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a9ed319e-d732-4930-89b4-7a61ea6cf930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d6efe568-bf8d-4342-bb0e-0a878f7cccf3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Migration 9eeef0d5-e302-41ae-970c-86ce849091ca is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e62931e3-90bb-4959-825c-e80dfc391989 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:46:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:39 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:39 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:39 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:39 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:39 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:39 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:39 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:46:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:43 user nova-compute[75239]: INFO nova.compute.manager [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Unshelving
Nov 13 20:46:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:43 user nova-compute[75239]: DEBUG nova.objects.instance [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'pci_requests' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:43 user nova-compute[75239]: DEBUG nova.objects.instance [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'numa_topology' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:43 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:46:43 user nova-compute[75239]: INFO nova.compute.claims [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Claim successful on node user
Nov 13 20:46:43 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:46:43 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:46:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:43 user nova-compute[75239]: INFO nova.network.neutron [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating port 0be4f3e6-716b-4a52-b027-5a84d8415292 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 20:46:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:46:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquired lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:46:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:46:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-2508e035-ba34-412d-9d93-a7d6fce327e0 req-cba274f1-973b-4fcc-a3cc-3e5d86e31300 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-changed-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-2508e035-ba34-412d-9d93-a7d6fce327e0 req-cba274f1-973b-4fcc-a3cc-3e5d86e31300 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Refreshing instance network info cache due to event network-changed-0be4f3e6-716b-4a52-b027-5a84d8415292. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:46:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2508e035-ba34-412d-9d93-a7d6fce327e0 req-cba274f1-973b-4fcc-a3cc-3e5d86e31300 service nova] Acquiring lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating instance_info_cache with network_info: [{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Releasing lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:46:45 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Creating image(s)
Nov 13 20:46:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG nova.objects.instance [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2508e035-ba34-412d-9d93-a7d6fce327e0 req-cba274f1-973b-4fcc-a3cc-3e5d86e31300 service nova] Acquired lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG nova.network.neutron [req-2508e035-ba34-412d-9d93-a7d6fce327e0 req-cba274f1-973b-4fcc-a3cc-3e5d86e31300 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Refreshing network info cache for port 0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG nova.objects.base [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<7525c321-c164-4d14-8364-23f07eb826b6> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "b17f70e6f080e8f87244d5ac9f2f933885bfb5f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "b17f70e6f080e8f87244d5ac9f2f933885bfb5f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 36c1f1d7-f3f9-4d41-b116-babf44d80f34 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.virt.images [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] 478e466f-f7cc-4126-a94e-8e3673980846 was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8.part /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.network.neutron [req-2508e035-ba34-412d-9d93-a7d6fce327e0 req-cba274f1-973b-4fcc-a3cc-3e5d86e31300 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updated VIF entry in instance network info cache for port 0be4f3e6-716b-4a52-b027-5a84d8415292. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.network.neutron [req-2508e035-ba34-412d-9d93-a7d6fce327e0 req-cba274f1-973b-4fcc-a3cc-3e5d86e31300 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating instance_info_cache with network_info: [{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2508e035-ba34-412d-9d93-a7d6fce327e0 req-cba274f1-973b-4fcc-a3cc-3e5d86e31300 service nova] Releasing lock "refresh_cache-7525c321-c164-4d14-8364-23f07eb826b6" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8.part /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8.converted" returned: 0 in 0.396s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updating instance_info_cache with network_info: [{"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-36c1f1d7-f3f9-4d41-b116-babf44d80f34" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "b17f70e6f080e8f87244d5ac9f2f933885bfb5f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.664s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8 --force-share --output=json" returned: 0 in 0.166s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "b17f70e6f080e8f87244d5ac9f2f933885bfb5f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "b17f70e6f080e8f87244d5ac9f2f933885bfb5f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8 --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8,backing_fmt=raw /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8,backing_fmt=raw /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk 1073741824" returned: 0 in 0.055s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "b17f70e6f080e8f87244d5ac9f2f933885bfb5f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8 --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG nova.objects.instance [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'migration_context' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG nova.objects.base [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<7525c321-c164-4d14-8364-23f07eb826b6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:46:47 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Rebasing disk image.
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 -F raw /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:46:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 -F raw /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk" returned: 0 in 2.163s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Ensure instance console log exists: /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Start _get_guest_xml network_info=[{"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c4989019fb6384c58efec80ef995cbce',container_format='bare',created_at=2023-11-13T20:44:50Z,direct_url=<?>,disk_format='qcow2',id=478e466f-f7cc-4126-a94e-8e3673980846,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1053010473-shelved',owner='2d28d93b700143a988524063d92a102a',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T20:44:55Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:46:49 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:46:49 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c4989019fb6384c58efec80ef995cbce',container_format='bare',created_at=2023-11-13T20:44:50Z,direct_url=<?>,disk_format='qcow2',id=478e466f-f7cc-4126-a94e-8e3673980846,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1053010473-shelved',owner='2d28d93b700143a988524063d92a102a',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T20:44:55Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.objects.instance [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.objects.base [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<7525c321-c164-4d14-8364-23f07eb826b6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1053010473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1053010473',id=28,image_ref='478e466f-f7cc-4126-a94e-8e3673980846',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-452032804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:43:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-fffww73p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member',shelved_at='2023-11-13T20:44:54.878880',shelved_host='user',shelved_image_id='478e466f-f7cc-4126-a94e-8e3673980846'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:46:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=7525c321-c164-4d14-8364-23f07eb826b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.objects.instance [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'pci_devices' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.objects.base [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Object Instance<7525c321-c164-4d14-8364-23f07eb826b6> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:46:49 user nova-compute[75239]:   <uuid>7525c321-c164-4d14-8364-23f07eb826b6</uuid>
Nov 13 20:46:49 user nova-compute[75239]:   <name>instance-0000001c</name>
Nov 13 20:46:49 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:46:49 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:46:49 user nova-compute[75239]:   <metadata>
Nov 13 20:46:49 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:46:49 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:46:49 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1053010473</nova:name>
Nov 13 20:46:49 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:46:49</nova:creationTime>
Nov 13 20:46:49 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:46:49 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:46:49 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:46:49 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:46:49 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:46:49 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:46:49 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:46:49 user nova-compute[75239]:       <nova:owner>
Nov 13 20:46:49 user nova-compute[75239]:         <nova:user uuid="21fc417bc25944ffb15dd30f9d7f0760">tempest-AttachVolumeShelveTestJSON-2022096331-project-member</nova:user>
Nov 13 20:46:49 user nova-compute[75239]:         <nova:project uuid="2d28d93b700143a988524063d92a102a">tempest-AttachVolumeShelveTestJSON-2022096331</nova:project>
Nov 13 20:46:49 user nova-compute[75239]:       </nova:owner>
Nov 13 20:46:49 user nova-compute[75239]:       <nova:root type="image" uuid="478e466f-f7cc-4126-a94e-8e3673980846"/>
Nov 13 20:46:49 user nova-compute[75239]:       <nova:ports>
Nov 13 20:46:49 user nova-compute[75239]:         <nova:port uuid="0be4f3e6-716b-4a52-b027-5a84d8415292">
Nov 13 20:46:49 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 20:46:49 user nova-compute[75239]:         </nova:port>
Nov 13 20:46:49 user nova-compute[75239]:       </nova:ports>
Nov 13 20:46:49 user nova-compute[75239]:     </nova:instance>
Nov 13 20:46:49 user nova-compute[75239]:   </metadata>
Nov 13 20:46:49 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:46:49 user nova-compute[75239]:     <system>
Nov 13 20:46:49 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:46:49 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:46:49 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:46:49 user nova-compute[75239]:       <entry name="serial">7525c321-c164-4d14-8364-23f07eb826b6</entry>
Nov 13 20:46:49 user nova-compute[75239]:       <entry name="uuid">7525c321-c164-4d14-8364-23f07eb826b6</entry>
Nov 13 20:46:49 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:46:49 user nova-compute[75239]:     </system>
Nov 13 20:46:49 user nova-compute[75239]:   </sysinfo>
Nov 13 20:46:49 user nova-compute[75239]:   <os>
Nov 13 20:46:49 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:46:49 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:46:49 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:46:49 user nova-compute[75239]:   </os>
Nov 13 20:46:49 user nova-compute[75239]:   <features>
Nov 13 20:46:49 user nova-compute[75239]:     <acpi/>
Nov 13 20:46:49 user nova-compute[75239]:     <apic/>
Nov 13 20:46:49 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:46:49 user nova-compute[75239]:   </features>
Nov 13 20:46:49 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:46:49 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:46:49 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:46:49 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:46:49 user nova-compute[75239]:   </clock>
Nov 13 20:46:49 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:46:49 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:46:49 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:46:49 user nova-compute[75239]:   </cpu>
Nov 13 20:46:49 user nova-compute[75239]:   <devices>
Nov 13 20:46:49 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:46:49 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:46:49 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk"/>
Nov 13 20:46:49 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:46:49 user nova-compute[75239]:     </disk>
Nov 13 20:46:49 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:46:49 user nova-compute[75239]:       <mac address="fa:16:3e:24:10:3f"/>
Nov 13 20:46:49 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:46:49 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:46:49 user nova-compute[75239]:       <target dev="tap0be4f3e6-71"/>
Nov 13 20:46:49 user nova-compute[75239]:     </interface>
Nov 13 20:46:49 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:46:49 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/console.log" append="off"/>
Nov 13 20:46:49 user nova-compute[75239]:     </serial>
Nov 13 20:46:49 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:46:49 user nova-compute[75239]:     <video>
Nov 13 20:46:49 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:46:49 user nova-compute[75239]:     </video>
Nov 13 20:46:49 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:46:49 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:46:49 user nova-compute[75239]:     </rng>
Nov 13 20:46:49 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:46:49 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:46:49 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:46:49 user nova-compute[75239]:     </memballoon>
Nov 13 20:46:49 user nova-compute[75239]:   </devices>
Nov 13 20:46:49 user nova-compute[75239]: </domain>
Nov 13 20:46:49 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1053010473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1053010473',id=28,image_ref='478e466f-f7cc-4126-a94e-8e3673980846',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-452032804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:43:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-fffww73p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member',shelved_at='2023-11-13T20:44:54.878880',shelved_host='user',shelved_image_id='478e466f-f7cc-4126-a94e-8e3673980846'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:46:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=7525c321-c164-4d14-8364-23f07eb826b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG os_vif [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8e8f295-99ce-5717-a1a6-cf1f0a931710', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0be4f3e6-71, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0be4f3e6-71, col_values=(('qos', UUID('36c902a4-133b-4978-be6c-190ff390e378')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0be4f3e6-71, col_values=(('external_ids', {'iface-id': '0be4f3e6-716b-4a52-b027-5a84d8415292', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:10:3f', 'vm-uuid': '7525c321-c164-4d14-8364-23f07eb826b6'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:49 user nova-compute[75239]: INFO os_vif [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71')
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:46:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] No VIF found with MAC fa:16:3e:24:10:3f, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-69a123ad-ed52-4efe-a1b1-927e7678446f req-333a6ea3-3a39-4112-ac01-40f7c0611771 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69a123ad-ed52-4efe-a1b1-927e7678446f req-333a6ea3-3a39-4112-ac01-40f7c0611771 service nova] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69a123ad-ed52-4efe-a1b1-927e7678446f req-333a6ea3-3a39-4112-ac01-40f7c0611771 service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-69a123ad-ed52-4efe-a1b1-927e7678446f req-333a6ea3-3a39-4112-ac01-40f7c0611771 service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-69a123ad-ed52-4efe-a1b1-927e7678446f req-333a6ea3-3a39-4112-ac01-40f7c0611771 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] No waiting events found dispatching network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:51 user nova-compute[75239]: WARNING nova.compute.manager [req-69a123ad-ed52-4efe-a1b1-927e7678446f req-333a6ea3-3a39-4112-ac01-40f7c0611771 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received unexpected event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 20:46:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:53 user nova-compute[75239]: DEBUG nova.compute.manager [req-e8a9ead4-1672-4d3f-b2a0-e278bf54421e req-1d7be208-ea75-434f-a105-fb46b0a58026 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:46:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e8a9ead4-1672-4d3f-b2a0-e278bf54421e req-1d7be208-ea75-434f-a105-fb46b0a58026 service nova] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:46:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e8a9ead4-1672-4d3f-b2a0-e278bf54421e req-1d7be208-ea75-434f-a105-fb46b0a58026 service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:46:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e8a9ead4-1672-4d3f-b2a0-e278bf54421e req-1d7be208-ea75-434f-a105-fb46b0a58026 service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:53 user nova-compute[75239]: DEBUG nova.compute.manager [req-e8a9ead4-1672-4d3f-b2a0-e278bf54421e req-1d7be208-ea75-434f-a105-fb46b0a58026 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] No waiting events found dispatching network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:46:53 user nova-compute[75239]: WARNING nova.compute.manager [req-e8a9ead4-1672-4d3f-b2a0-e278bf54421e req-1d7be208-ea75-434f-a105-fb46b0a58026 service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received unexpected event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 20:46:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:46:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:46:53 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance spawned successfully.
Nov 13 20:46:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:46:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-024936d5-c6a8-4a34-91f7-7d7c80cbe9f4 tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.385s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:46:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:46:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:47:01 user nova-compute[75239]: INFO nova.compute.claims [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Claim successful on node user
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:47:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.policy [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6abaa983d703498f9bcd47764794423c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53fd8f58057142af8d76c28d6b7b70c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:47:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Creating image(s)
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "/opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "/opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "/opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "32aa0b2340b9686276b64571bc2572d4e877c315" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "32aa0b2340b9686276b64571bc2572d4e877c315" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315.part --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Successfully created port: 50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG nova.virt.images [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] f5cc642c-0663-44cc-9cc2-4c6659b2ab71 was qcow2, converting to raw {{(pid=75239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG nova.privsep.utils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315.part /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315.converted {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315.part /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315.converted" returned: 0 in 0.262s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315.converted --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "32aa0b2340b9686276b64571bc2572d4e877c315" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.083s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315 --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "32aa0b2340b9686276b64571bc2572d4e877c315" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "32aa0b2340b9686276b64571bc2572d4e877c315" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Successfully updated port: 50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquired lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-c041cbea-e22c-4272-865a-ca6b843343b4 req-c74e6eeb-dde4-41ce-b13f-8c4a422d39ac service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-c041cbea-e22c-4272-865a-ca6b843343b4 req-c74e6eeb-dde4-41ce-b13f-8c4a422d39ac service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing instance network info cache due to event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c041cbea-e22c-4272-865a-ca6b843343b4 req-c74e6eeb-dde4-41ce-b13f-8c4a422d39ac service nova] Acquiring lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315 --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315,backing_fmt=raw /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-d8c0fa09-2e3c-4580-b47d-7fbd0c37ec41 req-76d94576-546b-4fae-8532-6c69ba7e0e95 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-changed-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.compute.manager [req-d8c0fa09-2e3c-4580-b47d-7fbd0c37ec41 req-76d94576-546b-4fae-8532-6c69ba7e0e95 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Refreshing instance network info cache due to event network-changed-6675cf99-b5e8-402b-a98e-d4190071da32. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d8c0fa09-2e3c-4580-b47d-7fbd0c37ec41 req-76d94576-546b-4fae-8532-6c69ba7e0e95 service nova] Acquiring lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d8c0fa09-2e3c-4580-b47d-7fbd0c37ec41 req-76d94576-546b-4fae-8532-6c69ba7e0e95 service nova] Acquired lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.network.neutron [req-d8c0fa09-2e3c-4580-b47d-7fbd0c37ec41 req-76d94576-546b-4fae-8532-6c69ba7e0e95 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Refreshing network info cache for port 6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315,backing_fmt=raw /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk 1073741824" returned: 0 in 0.069s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "32aa0b2340b9686276b64571bc2572d4e877c315" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315 --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.objects.instance [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'flavor' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Cannot resize image /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Ensure instance console log exists: /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:03 user nova-compute[75239]: INFO nova.compute.manager [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Attaching volume 74ef42f0-afde-4a16-a2d9-5e4e72b62c4c to /dev/vdb
Nov 13 20:47:03 user nova-compute[75239]: DEBUG os_brick.utils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a8b2bc-cea4-42e8-9ae1-c32bfdb77509]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e88513-b361-479c-9bf5-0cfd8d8632c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d84f53-4658-4a8f-84b4-1c6cd9564aeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[12306914-6b3d-4db7-b151-552a507d3724]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:47:04 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1b15d5-674d-4ec5-89f1-bece9323eeaa]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG os_brick.utils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating existing volume attachment record: 4ac39ac6-7007-46d8-854e-527e752a4e83 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updating instance_info_cache with network_info: [{"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Releasing lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Instance network_info: |[{"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c041cbea-e22c-4272-865a-ca6b843343b4 req-c74e6eeb-dde4-41ce-b13f-8c4a422d39ac service nova] Acquired lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.neutron [req-c041cbea-e22c-4272-865a-ca6b843343b4 req-c74e6eeb-dde4-41ce-b13f-8c4a422d39ac service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Start _get_guest_xml network_info=[{"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:46:59Z,direct_url=<?>,disk_format='qcow2',id=f5cc642c-0663-44cc-9cc2-4c6659b2ab71,min_disk=0,min_ram=0,name='tempest-scenario-img--915192698',owner='53fd8f58057142af8d76c28d6b7b70c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:47:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': 'f5cc642c-0663-44cc-9cc2-4c6659b2ab71'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:47:04 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:47:04 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:46:59Z,direct_url=<?>,disk_format='qcow2',id=f5cc642c-0663-44cc-9cc2-4c6659b2ab71,min_disk=0,min_ram=0,name='tempest-scenario-img--915192698',owner='53fd8f58057142af8d76c28d6b7b70c6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:47:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-431686731',display_name='tempest-TestMinimumBasicScenario-server-431686731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-431686731',id=33,image_ref='f5cc642c-0663-44cc-9cc2-4c6659b2ab71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcsH7r519PkQvflkhw6qSX6W8iCUEZBEh1ME3k5YxiuL1nIfb8ETuQ2q8+6B4hJrr/Ze/4qiKJOORCnj4QBNKNh+lg4ne/iMCRaR21AcsuaonRWw4dwWV3zogFF+kU8A==',key_name='tempest-TestMinimumBasicScenario-1595131035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53fd8f58057142af8d76c28d6b7b70c6',ramdisk_id='',reservation_id='r-ja578va6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5cc642c-0663-44cc-9cc2-4c6659b2ab71',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-168427819',owner_user_name='tempest-TestMinimumBasicScenario-168427819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:47:02Z,user_data=None,user_id='6abaa983d703498f9bcd47764794423c',uuid=be0bf428-fadf-4e08-87ac-9563fb31d1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converting VIF {"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=50b5756c-5cce-4cb1-94f0-6283cdc80052,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b5756c-5c') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.objects.instance [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'pci_devices' on Instance uuid be0bf428-fadf-4e08-87ac-9563fb31d1b8 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:47:04 user nova-compute[75239]:   <uuid>be0bf428-fadf-4e08-87ac-9563fb31d1b8</uuid>
Nov 13 20:47:04 user nova-compute[75239]:   <name>instance-00000021</name>
Nov 13 20:47:04 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:47:04 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:47:04 user nova-compute[75239]:   <metadata>
Nov 13 20:47:04 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:47:04 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:47:04 user nova-compute[75239]:       <nova:name>tempest-TestMinimumBasicScenario-server-431686731</nova:name>
Nov 13 20:47:04 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:47:04</nova:creationTime>
Nov 13 20:47:04 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:47:04 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:47:04 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:47:04 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:47:04 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:47:04 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:47:04 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:47:04 user nova-compute[75239]:       <nova:owner>
Nov 13 20:47:04 user nova-compute[75239]:         <nova:user uuid="6abaa983d703498f9bcd47764794423c">tempest-TestMinimumBasicScenario-168427819-project-member</nova:user>
Nov 13 20:47:04 user nova-compute[75239]:         <nova:project uuid="53fd8f58057142af8d76c28d6b7b70c6">tempest-TestMinimumBasicScenario-168427819</nova:project>
Nov 13 20:47:04 user nova-compute[75239]:       </nova:owner>
Nov 13 20:47:04 user nova-compute[75239]:       <nova:root type="image" uuid="f5cc642c-0663-44cc-9cc2-4c6659b2ab71"/>
Nov 13 20:47:04 user nova-compute[75239]:       <nova:ports>
Nov 13 20:47:04 user nova-compute[75239]:         <nova:port uuid="50b5756c-5cce-4cb1-94f0-6283cdc80052">
Nov 13 20:47:04 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 20:47:04 user nova-compute[75239]:         </nova:port>
Nov 13 20:47:04 user nova-compute[75239]:       </nova:ports>
Nov 13 20:47:04 user nova-compute[75239]:     </nova:instance>
Nov 13 20:47:04 user nova-compute[75239]:   </metadata>
Nov 13 20:47:04 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:47:04 user nova-compute[75239]:     <system>
Nov 13 20:47:04 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:47:04 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:47:04 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:47:04 user nova-compute[75239]:       <entry name="serial">be0bf428-fadf-4e08-87ac-9563fb31d1b8</entry>
Nov 13 20:47:04 user nova-compute[75239]:       <entry name="uuid">be0bf428-fadf-4e08-87ac-9563fb31d1b8</entry>
Nov 13 20:47:04 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:47:04 user nova-compute[75239]:     </system>
Nov 13 20:47:04 user nova-compute[75239]:   </sysinfo>
Nov 13 20:47:04 user nova-compute[75239]:   <os>
Nov 13 20:47:04 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:47:04 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:47:04 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:47:04 user nova-compute[75239]:   </os>
Nov 13 20:47:04 user nova-compute[75239]:   <features>
Nov 13 20:47:04 user nova-compute[75239]:     <acpi/>
Nov 13 20:47:04 user nova-compute[75239]:     <apic/>
Nov 13 20:47:04 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:47:04 user nova-compute[75239]:   </features>
Nov 13 20:47:04 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:47:04 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:47:04 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:47:04 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:47:04 user nova-compute[75239]:   </clock>
Nov 13 20:47:04 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:47:04 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:47:04 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:47:04 user nova-compute[75239]:   </cpu>
Nov 13 20:47:04 user nova-compute[75239]:   <devices>
Nov 13 20:47:04 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:47:04 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:47:04 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk"/>
Nov 13 20:47:04 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:47:04 user nova-compute[75239]:     </disk>
Nov 13 20:47:04 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:47:04 user nova-compute[75239]:       <mac address="fa:16:3e:1b:9e:7d"/>
Nov 13 20:47:04 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:47:04 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:47:04 user nova-compute[75239]:       <target dev="tap50b5756c-5c"/>
Nov 13 20:47:04 user nova-compute[75239]:     </interface>
Nov 13 20:47:04 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:47:04 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/console.log" append="off"/>
Nov 13 20:47:04 user nova-compute[75239]:     </serial>
Nov 13 20:47:04 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:47:04 user nova-compute[75239]:     <video>
Nov 13 20:47:04 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:47:04 user nova-compute[75239]:     </video>
Nov 13 20:47:04 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:47:04 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:47:04 user nova-compute[75239]:     </rng>
Nov 13 20:47:04 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:47:04 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:47:04 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:47:04 user nova-compute[75239]:     </memballoon>
Nov 13 20:47:04 user nova-compute[75239]:   </devices>
Nov 13 20:47:04 user nova-compute[75239]: </domain>
Nov 13 20:47:04 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-431686731',display_name='tempest-TestMinimumBasicScenario-server-431686731',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-431686731',id=33,image_ref='f5cc642c-0663-44cc-9cc2-4c6659b2ab71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcsH7r519PkQvflkhw6qSX6W8iCUEZBEh1ME3k5YxiuL1nIfb8ETuQ2q8+6B4hJrr/Ze/4qiKJOORCnj4QBNKNh+lg4ne/iMCRaR21AcsuaonRWw4dwWV3zogFF+kU8A==',key_name='tempest-TestMinimumBasicScenario-1595131035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='53fd8f58057142af8d76c28d6b7b70c6',ramdisk_id='',reservation_id='r-ja578va6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5cc642c-0663-44cc-9cc2-4c6659b2ab71',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-168427819',owner_user_name='tempest-TestMinimumBasicScenario-168427819-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:47:02Z,user_data=None,user_id='6abaa983d703498f9bcd47764794423c',uuid=be0bf428-fadf-4e08-87ac-9563fb31d1b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converting VIF {"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=50b5756c-5cce-4cb1-94f0-6283cdc80052,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b5756c-5c') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG os_vif [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=50b5756c-5cce-4cb1-94f0-6283cdc80052,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b5756c-5c') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ee305f5-9437-5502-a191-c9ed3164ab44', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50b5756c-5c, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50b5756c-5c, col_values=(('qos', UUID('cba026fe-8382-4b1f-b573-66ebed7fe1be')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50b5756c-5c, col_values=(('external_ids', {'iface-id': '50b5756c-5cce-4cb1-94f0-6283cdc80052', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:9e:7d', 'vm-uuid': 'be0bf428-fadf-4e08-87ac-9563fb31d1b8'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:04 user nova-compute[75239]: INFO os_vif [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=50b5756c-5cce-4cb1-94f0-6283cdc80052,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b5756c-5c')
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.neutron [req-d8c0fa09-2e3c-4580-b47d-7fbd0c37ec41 req-76d94576-546b-4fae-8532-6c69ba7e0e95 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updated VIF entry in instance network info cache for port 6675cf99-b5e8-402b-a98e-d4190071da32. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.neutron [req-d8c0fa09-2e3c-4580-b47d-7fbd0c37ec41 req-76d94576-546b-4fae-8532-6c69ba7e0e95 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No VIF found with MAC fa:16:3e:1b:9e:7d, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d8c0fa09-2e3c-4580-b47d-7fbd0c37ec41 req-76d94576-546b-4fae-8532-6c69ba7e0e95 service nova] Releasing lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.neutron [req-c041cbea-e22c-4272-865a-ca6b843343b4 req-c74e6eeb-dde4-41ce-b13f-8c4a422d39ac service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updated VIF entry in instance network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG nova.network.neutron [req-c041cbea-e22c-4272-865a-ca6b843343b4 req-c74e6eeb-dde4-41ce-b13f-8c4a422d39ac service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updating instance_info_cache with network_info: [{"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c041cbea-e22c-4272-865a-ca6b843343b4 req-c74e6eeb-dde4-41ce-b13f-8c4a422d39ac service nova] Releasing lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-d1f357bb-5fed-4672-8610-a99bbff360b9 req-799b632a-7610-4330-9fa2-560e777476ca service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d1f357bb-5fed-4672-8610-a99bbff360b9 req-799b632a-7610-4330-9fa2-560e777476ca service nova] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d1f357bb-5fed-4672-8610-a99bbff360b9 req-799b632a-7610-4330-9fa2-560e777476ca service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d1f357bb-5fed-4672-8610-a99bbff360b9 req-799b632a-7610-4330-9fa2-560e777476ca service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-d1f357bb-5fed-4672-8610-a99bbff360b9 req-799b632a-7610-4330-9fa2-560e777476ca service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] No waiting events found dispatching network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:06 user nova-compute[75239]: WARNING nova.compute.manager [req-d1f357bb-5fed-4672-8610-a99bbff360b9 req-799b632a-7610-4330-9fa2-560e777476ca service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received unexpected event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 for instance with vm_state building and task_state spawning.
Nov 13 20:47:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-437dfb7a-2246-4332-a375-9ec568ab937e req-24f945bf-9ac1-42ce-8fb7-48e53d7f8828 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-437dfb7a-2246-4332-a375-9ec568ab937e req-24f945bf-9ac1-42ce-8fb7-48e53d7f8828 service nova] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-437dfb7a-2246-4332-a375-9ec568ab937e req-24f945bf-9ac1-42ce-8fb7-48e53d7f8828 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-437dfb7a-2246-4332-a375-9ec568ab937e req-24f945bf-9ac1-42ce-8fb7-48e53d7f8828 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-437dfb7a-2246-4332-a375-9ec568ab937e req-24f945bf-9ac1-42ce-8fb7-48e53d7f8828 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] No waiting events found dispatching network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:08 user nova-compute[75239]: WARNING nova.compute.manager [req-437dfb7a-2246-4332-a375-9ec568ab937e req-24f945bf-9ac1-42ce-8fb7-48e53d7f8828 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received unexpected event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 for instance with vm_state building and task_state spawning.
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:47:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Instance spawned successfully.
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:08 user nova-compute[75239]: INFO nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Took 6.52 seconds to spawn the instance on the hypervisor.
Nov 13 20:47:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:47:08 user nova-compute[75239]: INFO nova.compute.manager [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Took 7.31 seconds to build instance.
Nov 13 20:47:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0dd18fca-de3e-46af-89f5-f9a683acf220 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.408s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zATExGtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:47:09 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:47:09 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:47:09 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e9825b-2184-4bd2-ba65-857cff68296e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:47:09 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6827422-a255-484e-9f06-24dd2f3d3c51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c] added
Nov 13 20:47:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b90b172-0abb-44a2-8078-2629b17bc3a4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6612f38-c2ef-4e7b-b7c9-44fff91c7dde]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zATExGtS {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zATExGtS" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[289f81d1-730c-45ab-859d-a096e3e756e9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zATExGtS'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc9f194-6daf-4f75-b39a-c4271e97dccb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ddf24a-4a54-41ca-bf7c-46e9ee5aeb18]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:47:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:47:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[775165d6-5ba8-4b2f-a9ef-2c618d9f7709]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c, portal: 172.16.0.220,3260]
Nov 13 20:47:09 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c, portal: 172.16.0.220,3260] successful.
Nov 13 20:47:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c222423a-7fda-496f-a13a-92df73d67d4f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b756a74-8d14-430f-b185-18b31543893f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:47:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:47:09 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:47:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15b01d3-b8b8-4127-aae1-b426e62d3a38]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zATExGtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:47:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-d2c7068c-e8c3-466f-9ea8-f3698b948457 req-05ee094c-6b35-4aea-819a-ff1cdac173af service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-d2c7068c-e8c3-466f-9ea8-f3698b948457 req-05ee094c-6b35-4aea-819a-ff1cdac173af service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing instance network info cache due to event network-changed-0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d2c7068c-e8c3-466f-9ea8-f3698b948457 req-05ee094c-6b35-4aea-819a-ff1cdac173af service nova] Acquiring lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d2c7068c-e8c3-466f-9ea8-f3698b948457 req-05ee094c-6b35-4aea-819a-ff1cdac173af service nova] Acquired lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.network.neutron [req-d2c7068c-e8c3-466f-9ea8-f3698b948457 req-05ee094c-6b35-4aea-819a-ff1cdac173af service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Refreshing network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:10 user nova-compute[75239]: INFO nova.compute.manager [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Terminating instance
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.compute.manager [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26266633132386439', 'path': '/dev/sde'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266633132386439', 'path': '/dev/sde'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.objects.instance [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'flavor' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:47:10 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:47:10 user nova-compute[75239]:   <source dev="/dev/sde"/>
Nov 13 20:47:10 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:47:10 user nova-compute[75239]:   <serial>74ef42f0-afde-4a16-a2d9-5e4e72b62c4c</serial>
Nov 13 20:47:10 user nova-compute[75239]: </disk>
Nov 13 20:47:10 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-67ef6e19-0695-49be-bc66-005cd0ab6710 req-a8cd58be-b48c-4e9b-875b-d884e52bb114 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-unplugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-67ef6e19-0695-49be-bc66-005cd0ab6710 req-a8cd58be-b48c-4e9b-875b-d884e52bb114 service nova] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-67ef6e19-0695-49be-bc66-005cd0ab6710 req-a8cd58be-b48c-4e9b-875b-d884e52bb114 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-67ef6e19-0695-49be-bc66-005cd0ab6710 req-a8cd58be-b48c-4e9b-875b-d884e52bb114 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-67ef6e19-0695-49be-bc66-005cd0ab6710 req-a8cd58be-b48c-4e9b-875b-d884e52bb114 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] No waiting events found dispatching network-vif-unplugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-67ef6e19-0695-49be-bc66-005cd0ab6710 req-a8cd58be-b48c-4e9b-875b-d884e52bb114 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-unplugged-0b40e357-282b-4698-9af6-41acd4aa408b for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.network.neutron [req-d2c7068c-e8c3-466f-9ea8-f3698b948457 req-05ee094c-6b35-4aea-819a-ff1cdac173af service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updated VIF entry in instance network info cache for port 0b40e357-282b-4698-9af6-41acd4aa408b. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG nova.network.neutron [req-d2c7068c-e8c3-466f-9ea8-f3698b948457 req-05ee094c-6b35-4aea-819a-ff1cdac173af service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [{"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d2c7068c-e8c3-466f-9ea8-f3698b948457 req-05ee094c-6b35-4aea-819a-ff1cdac173af service nova] Releasing lock "refresh_cache-d6efe568-bf8d-4342-bb0e-0a878f7cccf3" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No VIF found with MAC fa:16:3e:f3:36:75, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-76af9bfa-5391-45d9-8708-42044287ca5e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.293s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Instance destroyed successfully.
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.objects.instance [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lazy-loading 'resources' on Instance uuid d6efe568-bf8d-4342-bb0e-0a878f7cccf3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:41:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1104629884',display_name='tempest-TestShelveInstance-server-1104629884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1104629884',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIKH+oCJ3NUeycdEu6o0ACiWfJa/kxXrNTIHezDCjZ4hZvwPmJKxpD3DthYAcv9iLh2oZ3SAgjtnpJ0CtwHOrOkHMhfLVc1u+0r3+jR3oH11gC8/uAbwmubEO5JCg7CFQ==',key_name='tempest-TestShelveInstance-438861881',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:45:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b4a480ab579c451799fbaac4af653379',ramdisk_id='',reservation_id='r-febrlktk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1910953819',owner_user_name='tempest-TestShelveInstance-1910953819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:45:32Z,user_data=None,user_id='41ee3d20cab9440d9564a3b536668fda',uuid=d6efe568-bf8d-4342-bb0e-0a878f7cccf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converting VIF {"id": "0b40e357-282b-4698-9af6-41acd4aa408b", "address": "fa:16:3e:9d:cb:d3", "network": {"id": "75b59c5f-1d17-4e21-8117-33495f5bd401", "bridge": "br-int", "label": "tempest-TestShelveInstance-1420133254-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b4a480ab579c451799fbaac4af653379", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b40e357-28", "ovs_interfaceid": "0b40e357-282b-4698-9af6-41acd4aa408b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_vif [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b40e357-28, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79bf8297-a160-44cb-b8dc-64011a1de45c) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:11 user nova-compute[75239]: INFO os_vif [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:cb:d3,bridge_name='br-int',has_traffic_filtering=True,id=0b40e357-282b-4698-9af6-41acd4aa408b,network=Network(75b59c5f-1d17-4e21-8117-33495f5bd401),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b40e357-28')
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKRGSQhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:47:11 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a5b2c7-b580-4792-9506-38c29196fed1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:47:11 user nova-compute[75239]: No targets found.
Nov 13 20:47:11 user nova-compute[75239]: iSNS:
Nov 13 20:47:11 user nova-compute[75239]: No targets found.
Nov 13 20:47:11 user nova-compute[75239]: STATIC:
Nov 13 20:47:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:47:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:47:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:47:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:47:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:47:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:47:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:47:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:47:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:47:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6
Nov 13 20:47:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:47:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:47:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b
Nov 13 20:47:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:47:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:47:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c
Nov 13 20:47:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:47:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:47:11 user nova-compute[75239]: FIRMWARE:
Nov 13 20:47:11 user nova-compute[75239]: No targets found.
Nov 13 20:47:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:47:11 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:47:11 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb2ae01-2b8f-445e-b602-648a6d2a2dd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b09394-a8b2-40e3-9b38-ee3f27308e3a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:47:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:47:11 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:47:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d8428aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f69c57a-704a-4a32-a941-302d461bba67]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bad5f7c-0385-4ec1-bbc2-f049173136ba]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b41138a-f328-47e8-b588-9494584034fa]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67681a6c-5e84-4b0f-ade8-2153007bc795]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e4f0c9-fee2-4523-bbf8-f24411d9bb09]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf5eb7-b358-433b-b85d-77c149c034d7]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260]
Nov 13 20:47:11 user nova-compute[75239]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6, portal: 172.16.0.220,3260] successful.
Nov 13 20:47:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c41538ee-cd29-4af9-b597-09cfc25852c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[773a7a1a-b860-459f-98fc-6c1aca6339a8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] <== disconnect_volume: return (373ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:47:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Deleting instance files /opt/stack/data/nova/instances/d6efe568-bf8d-4342-bb0e-0a878f7cccf3_del
Nov 13 20:47:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Deletion of /opt/stack/data/nova/instances/d6efe568-bf8d-4342-bb0e-0a878f7cccf3_del complete
Nov 13 20:47:11 user nova-compute[75239]: INFO nova.compute.manager [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Rescuing
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquired lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.network.neutron [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:47:11 user nova-compute[75239]: INFO nova.compute.manager [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 13 20:47:11 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:47:11 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG nova.network.neutron [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Releasing lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:12 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Took 0.84 seconds to deallocate network for instance.
Nov 13 20:47:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-ccfe2dcc-97ea-4379-8a1f-47d721e3d8bf req-66071382-ef44-4e9b-b6db-c2158b4bb084 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-deleted-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:12 user nova-compute[75239]: INFO nova.compute.manager [req-ccfe2dcc-97ea-4379-8a1f-47d721e3d8bf req-66071382-ef44-4e9b-b6db-c2158b4bb084 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Neutron deleted interface 0b40e357-282b-4698-9af6-41acd4aa408b; detaching it from the instance and deleting it from the info cache
Nov 13 20:47:12 user nova-compute[75239]: DEBUG nova.network.neutron [req-ccfe2dcc-97ea-4379-8a1f-47d721e3d8bf req-66071382-ef44-4e9b-b6db-c2158b4bb084 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-ccfe2dcc-97ea-4379-8a1f-47d721e3d8bf req-66071382-ef44-4e9b-b6db-c2158b4bb084 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Detach interface failed, port_id=0b40e357-282b-4698-9af6-41acd4aa408b, reason: Instance d6efe568-bf8d-4342-bb0e-0a878f7cccf3 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-9b03921d-a7d3-45f7-9265-d01f1f97a7ce req-be5c443d-5295-41f1-ab0a-d291293db063 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9b03921d-a7d3-45f7-9265-d01f1f97a7ce req-be5c443d-5295-41f1-ab0a-d291293db063 service nova] Acquiring lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9b03921d-a7d3-45f7-9265-d01f1f97a7ce req-be5c443d-5295-41f1-ab0a-d291293db063 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9b03921d-a7d3-45f7-9265-d01f1f97a7ce req-be5c443d-5295-41f1-ab0a-d291293db063 service nova] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-9b03921d-a7d3-45f7-9265-d01f1f97a7ce req-be5c443d-5295-41f1-ab0a-d291293db063 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] No waiting events found dispatching network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:12 user nova-compute[75239]: WARNING nova.compute.manager [req-9b03921d-a7d3-45f7-9265-d01f1f97a7ce req-be5c443d-5295-41f1-ab0a-d291293db063 service nova] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Received unexpected event network-vif-plugged-0b40e357-282b-4698-9af6-41acd4aa408b for instance with vm_state active and task_state deleting.
Nov 13 20:47:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-658d326a-f53e-4eed-80e5-e5828d0ff891 req-63dc0af3-b48b-4d1b-955b-fb901b576065 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-unplugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-658d326a-f53e-4eed-80e5-e5828d0ff891 req-63dc0af3-b48b-4d1b-955b-fb901b576065 service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-658d326a-f53e-4eed-80e5-e5828d0ff891 req-63dc0af3-b48b-4d1b-955b-fb901b576065 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-658d326a-f53e-4eed-80e5-e5828d0ff891 req-63dc0af3-b48b-4d1b-955b-fb901b576065 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-658d326a-f53e-4eed-80e5-e5828d0ff891 req-63dc0af3-b48b-4d1b-955b-fb901b576065 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-unplugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:12 user nova-compute[75239]: WARNING nova.compute.manager [req-658d326a-f53e-4eed-80e5-e5828d0ff891 req-63dc0af3-b48b-4d1b-955b-fb901b576065 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-unplugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state active and task_state rescuing.
Nov 13 20:47:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance destroyed successfully.
Nov 13 20:47:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Attempting rescue
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance directory exists: not creating {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 20:47:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Creating image(s)
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'trusted_certs' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue" returned: 0 in 0.054s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'migration_context' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.base [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<a9ed319e-d732-4930-89b4-7a61ea6cf930> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Start _get_guest_xml network_info=[{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "vif_mac": "fa:16:3e:f3:36:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'resources' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:13 user nova-compute[75239]: INFO nova.compute.manager [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Took 1.21 seconds to detach 1 volumes for instance.
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] [instance: d6efe568-bf8d-4342-bb0e-0a878f7cccf3] Deleting volume: c41538ee-cd29-4af9-b597-09cfc25852c6 {{(pid=75239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.base [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<a9ed319e-d732-4930-89b4-7a61ea6cf930> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'numa_topology' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.base [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<a9ed319e-d732-4930-89b4-7a61ea6cf930> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:47:13 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:47:13 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'vcpu_model' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.base [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<a9ed319e-d732-4930-89b4-7a61ea6cf930> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-311739780',display_name='tempest-ServerRescueNegativeTestJSON-server-311739780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-311739780',id=32,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQHU08M836BbGVao+ri5az9a01m1uenSgGJY98kRt5kmxA3tDm3mza3xC5VS+TtacpZ3tivyEPNeLEhfhn2gg2qW5JEYB4XVJ+T18O/ixYV7AxTWGA6aYw1su8KACIoNg==',key_name='tempest-keypair-1400005984',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:45:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-0yuevxk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b27083a4000d4ba2832a394b9140b530',uuid=a9ed319e-d732-4930-89b4-7a61ea6cf930,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "vif_mac": "fa:16:3e:f3:36:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "vif_mac": "fa:16:3e:f3:36:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:36:75,bridge_name='br-int',has_traffic_filtering=True,id=6675cf99-b5e8-402b-a98e-d4190071da32,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6675cf99-b5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'pci_devices' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.objects.base [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Object Instance<a9ed319e-d732-4930-89b4-7a61ea6cf930> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:47:13 user nova-compute[75239]:   <uuid>a9ed319e-d732-4930-89b4-7a61ea6cf930</uuid>
Nov 13 20:47:13 user nova-compute[75239]:   <name>instance-00000020</name>
Nov 13 20:47:13 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:47:13 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:47:13 user nova-compute[75239]:   <metadata>
Nov 13 20:47:13 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:47:13 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:47:13 user nova-compute[75239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-311739780</nova:name>
Nov 13 20:47:13 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:47:13</nova:creationTime>
Nov 13 20:47:13 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:47:13 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:47:13 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:47:13 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:47:13 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:47:13 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:47:13 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:47:13 user nova-compute[75239]:       <nova:owner>
Nov 13 20:47:13 user nova-compute[75239]:         <nova:user uuid="b27083a4000d4ba2832a394b9140b530">tempest-ServerRescueNegativeTestJSON-1212200086-project-member</nova:user>
Nov 13 20:47:13 user nova-compute[75239]:         <nova:project uuid="41532512e3494bfd9051c340c2557bfe">tempest-ServerRescueNegativeTestJSON-1212200086</nova:project>
Nov 13 20:47:13 user nova-compute[75239]:       </nova:owner>
Nov 13 20:47:13 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:47:13 user nova-compute[75239]:       <nova:ports>
Nov 13 20:47:13 user nova-compute[75239]:         <nova:port uuid="6675cf99-b5e8-402b-a98e-d4190071da32">
Nov 13 20:47:13 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 20:47:13 user nova-compute[75239]:         </nova:port>
Nov 13 20:47:13 user nova-compute[75239]:       </nova:ports>
Nov 13 20:47:13 user nova-compute[75239]:     </nova:instance>
Nov 13 20:47:13 user nova-compute[75239]:   </metadata>
Nov 13 20:47:13 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:47:13 user nova-compute[75239]:     <system>
Nov 13 20:47:13 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:47:13 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:47:13 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:47:13 user nova-compute[75239]:       <entry name="serial">a9ed319e-d732-4930-89b4-7a61ea6cf930</entry>
Nov 13 20:47:13 user nova-compute[75239]:       <entry name="uuid">a9ed319e-d732-4930-89b4-7a61ea6cf930</entry>
Nov 13 20:47:13 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:47:13 user nova-compute[75239]:     </system>
Nov 13 20:47:13 user nova-compute[75239]:   </sysinfo>
Nov 13 20:47:13 user nova-compute[75239]:   <os>
Nov 13 20:47:13 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:47:13 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:47:13 user nova-compute[75239]:   </os>
Nov 13 20:47:13 user nova-compute[75239]:   <features>
Nov 13 20:47:13 user nova-compute[75239]:     <acpi/>
Nov 13 20:47:13 user nova-compute[75239]:     <apic/>
Nov 13 20:47:13 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:47:13 user nova-compute[75239]:   </features>
Nov 13 20:47:13 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:47:13 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:47:13 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:47:13 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:47:13 user nova-compute[75239]:   </clock>
Nov 13 20:47:13 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:47:13 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:47:13 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:47:13 user nova-compute[75239]:   </cpu>
Nov 13 20:47:13 user nova-compute[75239]:   <devices>
Nov 13 20:47:13 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:47:13 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:47:13 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue"/>
Nov 13 20:47:13 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:47:13 user nova-compute[75239]:     </disk>
Nov 13 20:47:13 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:47:13 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:47:13 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk"/>
Nov 13 20:47:13 user nova-compute[75239]:       <target dev="vdb" bus="virtio"/>
Nov 13 20:47:13 user nova-compute[75239]:     </disk>
Nov 13 20:47:13 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:47:13 user nova-compute[75239]:       <mac address="fa:16:3e:f3:36:75"/>
Nov 13 20:47:13 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:47:13 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:47:13 user nova-compute[75239]:       <target dev="tap6675cf99-b5"/>
Nov 13 20:47:13 user nova-compute[75239]:     </interface>
Nov 13 20:47:13 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:47:13 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/console.log" append="off"/>
Nov 13 20:47:13 user nova-compute[75239]:     </serial>
Nov 13 20:47:13 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:47:13 user nova-compute[75239]:     <video>
Nov 13 20:47:13 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:47:13 user nova-compute[75239]:     </video>
Nov 13 20:47:13 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:47:13 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:47:13 user nova-compute[75239]:     </rng>
Nov 13 20:47:13 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:47:13 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:47:13 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:47:13 user nova-compute[75239]:     </memballoon>
Nov 13 20:47:13 user nova-compute[75239]:   </devices>
Nov 13 20:47:13 user nova-compute[75239]: </domain>
Nov 13 20:47:13 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance destroyed successfully.
Nov 13 20:47:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] No VIF found with MAC fa:16:3e:f3:36:75, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:14 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Deleted allocations for instance d6efe568-bf8d-4342-bb0e-0a878f7cccf3
Nov 13 20:47:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eafb6cf9-6202-4bda-baae-72e5e00a56ef tempest-TestShelveInstance-1910953819 tempest-TestShelveInstance-1910953819-project-member] Lock "d6efe568-bf8d-4342-bb0e-0a878f7cccf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.242s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-4b414d4f-2d2b-4e8e-93df-1adb8ebbbf4c req-2b819b69-a3cd-4223-aff5-81dfac3d7650 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4b414d4f-2d2b-4e8e-93df-1adb8ebbbf4c req-2b819b69-a3cd-4223-aff5-81dfac3d7650 service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4b414d4f-2d2b-4e8e-93df-1adb8ebbbf4c req-2b819b69-a3cd-4223-aff5-81dfac3d7650 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4b414d4f-2d2b-4e8e-93df-1adb8ebbbf4c req-2b819b69-a3cd-4223-aff5-81dfac3d7650 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-4b414d4f-2d2b-4e8e-93df-1adb8ebbbf4c req-2b819b69-a3cd-4223-aff5-81dfac3d7650 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:14 user nova-compute[75239]: WARNING nova.compute.manager [req-4b414d4f-2d2b-4e8e-93df-1adb8ebbbf4c req-2b819b69-a3cd-4223-aff5-81dfac3d7650 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state active and task_state rescuing.
Nov 13 20:47:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:16 user nova-compute[75239]: WARNING nova.compute.manager [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state active and task_state rescuing.
Nov 13 20:47:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:16 user nova-compute[75239]: WARNING nova.compute.manager [req-6ecec1c1-7c0b-4def-8bc5-6ec19b90b135 req-4404546b-5efc-4475-b200-4dcf76d52a9c service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state active and task_state rescuing.
Nov 13 20:47:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7205f034-6dc3-4b25-917a-ac171a9ac7c1 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:47:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:47:35 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:47:36 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:40 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:47:40 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7381MB free_disk=24.64450454711914GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Applying migration context for instance e62931e3-90bb-4959-825c-e80dfc391989 as it has an incoming, in-progress migration 9eeef0d5-e302-41ae-970c-86ce849091ca. Migration status is finished {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 20:47:40 user nova-compute[75239]: INFO nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating resource usage from migration 9eeef0d5-e302-41ae-970c-86ce849091ca
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 0ba53275-7df4-4ecf-a4cc-860975b83d5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a9ed319e-d732-4930-89b4-7a61ea6cf930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Migration 9eeef0d5-e302-41ae-970c-86ce849091ca is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e62931e3-90bb-4959-825c-e80dfc391989 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 7525c321-c164-4d14-8364-23f07eb826b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Going to confirm migration 2 {{(pid=75239) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquired lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:47:40 user nova-compute[75239]: DEBUG nova.objects.instance [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'info_cache' on Instance uuid e62931e3-90bb-4959-825c-e80dfc391989 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating instance_info_cache with network_info: [{"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Releasing lock "refresh_cache-e62931e3-90bb-4959-825c-e80dfc391989" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG nova.objects.instance [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'migration_context' on Instance uuid e62931e3-90bb-4959-825c-e80dfc391989 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG nova.objects.base [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Object Instance<e62931e3-90bb-4959-825c-e80dfc391989> lazy-loaded attributes: info_cache,migration_context {{(pid=75239) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:47:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.448s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:42 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Deleted allocation for migration 9eeef0d5-e302-41ae-970c-86ce849091ca
Nov 13 20:47:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-94961250-524f-49e4-aa8e-fcf0133ae6d5 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.546s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:47:44 user nova-compute[75239]: INFO nova.compute.claims [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Claim successful on node user
Nov 13 20:47:44 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:47:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:47:44 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:47:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG nova.policy [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b99b7e2d05b45b3855c6d4debeb46a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2074bf752f49f58f8ccc88a33b6309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:47:45 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Creating image(s)
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "/opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "/opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "/opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk 1073741824" returned: 0 in 0.061s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Cannot resize image /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Ensure instance console log exists: /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Successfully created port: 8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updating instance_info_cache with network_info: [{"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-d816fbc5-c148-472b-9ade-c0175ccb38e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Successfully updated port: 8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "refresh_cache-518c0f36-dfaa-4e63-808c-dbccbba06d1d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquired lock "refresh_cache-518c0f36-dfaa-4e63-808c-dbccbba06d1d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG nova.compute.manager [req-62a20d85-0e7d-41c6-8b33-a13336417890 req-45ab0592-07bd-4d41-a901-132382501a54 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received event network-changed-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG nova.compute.manager [req-62a20d85-0e7d-41c6-8b33-a13336417890 req-45ab0592-07bd-4d41-a901-132382501a54 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Refreshing instance network info cache due to event network-changed-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-62a20d85-0e7d-41c6-8b33-a13336417890 req-45ab0592-07bd-4d41-a901-132382501a54 service nova] Acquiring lock "refresh_cache-518c0f36-dfaa-4e63-808c-dbccbba06d1d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Updating instance_info_cache with network_info: [{"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Releasing lock "refresh_cache-518c0f36-dfaa-4e63-808c-dbccbba06d1d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Instance network_info: |[{"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-62a20d85-0e7d-41c6-8b33-a13336417890 req-45ab0592-07bd-4d41-a901-132382501a54 service nova] Acquired lock "refresh_cache-518c0f36-dfaa-4e63-808c-dbccbba06d1d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-62a20d85-0e7d-41c6-8b33-a13336417890 req-45ab0592-07bd-4d41-a901-132382501a54 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Refreshing network info cache for port 8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Start _get_guest_xml network_info=[{"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:47:47 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:47:47 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-318872119',display_name='tempest-VolumesActionsTest-instance-318872119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-318872119',id=34,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc2074bf752f49f58f8ccc88a33b6309',ramdisk_id='',reservation_id='r-nvtm8xi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1662331085',owner_user_name='tempest-VolumesActionsTest-1662331085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:47:45Z,user_data=None,user_id='8b99b7e2d05b45b3855c6d4debeb46a2',uuid=518c0f36-dfaa-4e63-808c-dbccbba06d1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converting VIF {"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:1e:31,bridge_name='br-int',has_traffic_filtering=True,id=8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a2ce1-1a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.objects.instance [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lazy-loading 'pci_devices' on Instance uuid 518c0f36-dfaa-4e63-808c-dbccbba06d1d {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:47:47 user nova-compute[75239]:   <uuid>518c0f36-dfaa-4e63-808c-dbccbba06d1d</uuid>
Nov 13 20:47:47 user nova-compute[75239]:   <name>instance-00000022</name>
Nov 13 20:47:47 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:47:47 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:47:47 user nova-compute[75239]:   <metadata>
Nov 13 20:47:47 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:47:47 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:47:47 user nova-compute[75239]:       <nova:name>tempest-VolumesActionsTest-instance-318872119</nova:name>
Nov 13 20:47:47 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:47:47</nova:creationTime>
Nov 13 20:47:47 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:47:47 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:47:47 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:47:47 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:47:47 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:47:47 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:47:47 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:47:47 user nova-compute[75239]:       <nova:owner>
Nov 13 20:47:47 user nova-compute[75239]:         <nova:user uuid="8b99b7e2d05b45b3855c6d4debeb46a2">tempest-VolumesActionsTest-1662331085-project-member</nova:user>
Nov 13 20:47:47 user nova-compute[75239]:         <nova:project uuid="dc2074bf752f49f58f8ccc88a33b6309">tempest-VolumesActionsTest-1662331085</nova:project>
Nov 13 20:47:47 user nova-compute[75239]:       </nova:owner>
Nov 13 20:47:47 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:47:47 user nova-compute[75239]:       <nova:ports>
Nov 13 20:47:47 user nova-compute[75239]:         <nova:port uuid="8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b">
Nov 13 20:47:47 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 20:47:47 user nova-compute[75239]:         </nova:port>
Nov 13 20:47:47 user nova-compute[75239]:       </nova:ports>
Nov 13 20:47:47 user nova-compute[75239]:     </nova:instance>
Nov 13 20:47:47 user nova-compute[75239]:   </metadata>
Nov 13 20:47:47 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:47:47 user nova-compute[75239]:     <system>
Nov 13 20:47:47 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:47:47 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:47:47 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:47:47 user nova-compute[75239]:       <entry name="serial">518c0f36-dfaa-4e63-808c-dbccbba06d1d</entry>
Nov 13 20:47:47 user nova-compute[75239]:       <entry name="uuid">518c0f36-dfaa-4e63-808c-dbccbba06d1d</entry>
Nov 13 20:47:47 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:47:47 user nova-compute[75239]:     </system>
Nov 13 20:47:47 user nova-compute[75239]:   </sysinfo>
Nov 13 20:47:47 user nova-compute[75239]:   <os>
Nov 13 20:47:47 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:47:47 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:47:47 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:47:47 user nova-compute[75239]:   </os>
Nov 13 20:47:47 user nova-compute[75239]:   <features>
Nov 13 20:47:47 user nova-compute[75239]:     <acpi/>
Nov 13 20:47:47 user nova-compute[75239]:     <apic/>
Nov 13 20:47:47 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:47:47 user nova-compute[75239]:   </features>
Nov 13 20:47:47 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:47:47 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:47:47 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:47:47 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:47:47 user nova-compute[75239]:   </clock>
Nov 13 20:47:47 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:47:47 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:47:47 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:47:47 user nova-compute[75239]:   </cpu>
Nov 13 20:47:47 user nova-compute[75239]:   <devices>
Nov 13 20:47:47 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:47:47 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:47:47 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk"/>
Nov 13 20:47:47 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:47:47 user nova-compute[75239]:     </disk>
Nov 13 20:47:47 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:47:47 user nova-compute[75239]:       <mac address="fa:16:3e:40:1e:31"/>
Nov 13 20:47:47 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:47:47 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:47:47 user nova-compute[75239]:       <target dev="tap8c7a2ce1-1a"/>
Nov 13 20:47:47 user nova-compute[75239]:     </interface>
Nov 13 20:47:47 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:47:47 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/console.log" append="off"/>
Nov 13 20:47:47 user nova-compute[75239]:     </serial>
Nov 13 20:47:47 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:47:47 user nova-compute[75239]:     <video>
Nov 13 20:47:47 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:47:47 user nova-compute[75239]:     </video>
Nov 13 20:47:47 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:47:47 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:47:47 user nova-compute[75239]:     </rng>
Nov 13 20:47:47 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:47:47 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:47:47 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:47:47 user nova-compute[75239]:     </memballoon>
Nov 13 20:47:47 user nova-compute[75239]:   </devices>
Nov 13 20:47:47 user nova-compute[75239]: </domain>
Nov 13 20:47:47 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-318872119',display_name='tempest-VolumesActionsTest-instance-318872119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-318872119',id=34,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc2074bf752f49f58f8ccc88a33b6309',ramdisk_id='',reservation_id='r-nvtm8xi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1662331085',owner_user_name='tempest-VolumesActionsTest-1662331085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:47:45Z,user_data=None,user_id='8b99b7e2d05b45b3855c6d4debeb46a2',uuid=518c0f36-dfaa-4e63-808c-dbccbba06d1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converting VIF {"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:1e:31,bridge_name='br-int',has_traffic_filtering=True,id=8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a2ce1-1a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG os_vif [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:1e:31,bridge_name='br-int',has_traffic_filtering=True,id=8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a2ce1-1a') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3a0c384-19d1-588a-b0b0-aec5a40f595c', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c7a2ce1-1a, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c7a2ce1-1a, col_values=(('qos', UUID('a9f4b973-54e6-479e-a2ee-1e607f5c1084')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c7a2ce1-1a, col_values=(('external_ids', {'iface-id': '8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:1e:31', 'vm-uuid': '518c0f36-dfaa-4e63-808c-dbccbba06d1d'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:47 user nova-compute[75239]: INFO os_vif [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:1e:31,bridge_name='br-int',has_traffic_filtering=True,id=8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a2ce1-1a')
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] No VIF found with MAC fa:16:3e:40:1e:31, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-62a20d85-0e7d-41c6-8b33-a13336417890 req-45ab0592-07bd-4d41-a901-132382501a54 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Updated VIF entry in instance network info cache for port 8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-62a20d85-0e7d-41c6-8b33-a13336417890 req-45ab0592-07bd-4d41-a901-132382501a54 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Updating instance_info_cache with network_info: [{"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-62a20d85-0e7d-41c6-8b33-a13336417890 req-45ab0592-07bd-4d41-a901-132382501a54 service nova] Releasing lock "refresh_cache-518c0f36-dfaa-4e63-808c-dbccbba06d1d" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-830d41a4-c0e6-4fb8-a873-84fc04b7f5e0 req-0bf533f8-450c-425f-bcb3-cca2e09f16c0 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received event network-vif-plugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-830d41a4-c0e6-4fb8-a873-84fc04b7f5e0 req-0bf533f8-450c-425f-bcb3-cca2e09f16c0 service nova] Acquiring lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-830d41a4-c0e6-4fb8-a873-84fc04b7f5e0 req-0bf533f8-450c-425f-bcb3-cca2e09f16c0 service nova] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-830d41a4-c0e6-4fb8-a873-84fc04b7f5e0 req-0bf533f8-450c-425f-bcb3-cca2e09f16c0 service nova] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-830d41a4-c0e6-4fb8-a873-84fc04b7f5e0 req-0bf533f8-450c-425f-bcb3-cca2e09f16c0 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] No waiting events found dispatching network-vif-plugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:49 user nova-compute[75239]: WARNING nova.compute.manager [req-830d41a4-c0e6-4fb8-a873-84fc04b7f5e0 req-0bf533f8-450c-425f-bcb3-cca2e09f16c0 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received unexpected event network-vif-plugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b for instance with vm_state building and task_state spawning.
Nov 13 20:47:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:49 user nova-compute[75239]: INFO nova.compute.manager [None req-9a48158f-6000-4e35-982d-bdf91138c34f tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Unrescuing
Nov 13 20:47:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9a48158f-6000-4e35-982d-bdf91138c34f tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9a48158f-6000-4e35-982d-bdf91138c34f tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquired lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9a48158f-6000-4e35-982d-bdf91138c34f tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9a48158f-6000-4e35-982d-bdf91138c34f tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Updating instance_info_cache with network_info: [{"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9a48158f-6000-4e35-982d-bdf91138c34f tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Releasing lock "refresh_cache-0ba53275-7df4-4ecf-a4cc-860975b83d5f" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:47:49 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9a48158f-6000-4e35-982d-bdf91138c34f tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'flavor' on Instance uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-1997bfc5-0324-4eb7-b56d-346fa55fa637 req-83a9f83f-b437-4f7b-b6f4-3638e0d5215a service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-unplugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1997bfc5-0324-4eb7-b56d-346fa55fa637 req-83a9f83f-b437-4f7b-b6f4-3638e0d5215a service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1997bfc5-0324-4eb7-b56d-346fa55fa637 req-83a9f83f-b437-4f7b-b6f4-3638e0d5215a service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1997bfc5-0324-4eb7-b56d-346fa55fa637 req-83a9f83f-b437-4f7b-b6f4-3638e0d5215a service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-1997bfc5-0324-4eb7-b56d-346fa55fa637 req-83a9f83f-b437-4f7b-b6f4-3638e0d5215a service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-unplugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:50 user nova-compute[75239]: WARNING nova.compute.manager [req-1997bfc5-0324-4eb7-b56d-346fa55fa637 req-83a9f83f-b437-4f7b-b6f4-3638e0d5215a service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-unplugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:47:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:50 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Instance destroyed successfully.
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:47:50 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Instance spawned successfully.
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:47:51 user nova-compute[75239]: INFO nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 13 20:47:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:47:51 user nova-compute[75239]: INFO nova.compute.manager [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Took 6.79 seconds to build instance.
Nov 13 20:47:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9e4b55e-87dd-45de-9965-f41c0f713901 req-3c59cec6-159c-4e66-8a10-4a581fc39be3 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received event network-vif-plugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9e4b55e-87dd-45de-9965-f41c0f713901 req-3c59cec6-159c-4e66-8a10-4a581fc39be3 service nova] Acquiring lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9e4b55e-87dd-45de-9965-f41c0f713901 req-3c59cec6-159c-4e66-8a10-4a581fc39be3 service nova] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d9e4b55e-87dd-45de-9965-f41c0f713901 req-3c59cec6-159c-4e66-8a10-4a581fc39be3 service nova] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-d9e4b55e-87dd-45de-9965-f41c0f713901 req-3c59cec6-159c-4e66-8a10-4a581fc39be3 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] No waiting events found dispatching network-vif-plugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:51 user nova-compute[75239]: WARNING nova.compute.manager [req-d9e4b55e-87dd-45de-9965-f41c0f713901 req-3c59cec6-159c-4e66-8a10-4a581fc39be3 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received unexpected event network-vif-plugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b for instance with vm_state active and task_state None.
Nov 13 20:47:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c0a65fad-cc20-42af-9dbc-77d6c12ddd96 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.914s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:52 user nova-compute[75239]: WARNING nova.compute.manager [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:47:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:52 user nova-compute[75239]: WARNING nova.compute.manager [req-45350b3b-502b-41d2-9f42-e70a0c40ab71 req-a234cdac-6841-4b9b-9af3-d8343afc528d service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:47:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9a48158f-6000-4e35-982d-bdf91138c34f tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:47:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0aa70b3-3ef2-44d5-a747-b7ee6d45ea1c req-4bdc3409-0a8b-40e9-a0f0-3ca018250b99 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:47:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0aa70b3-3ef2-44d5-a747-b7ee6d45ea1c req-4bdc3409-0a8b-40e9-a0f0-3ca018250b99 service nova] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:47:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0aa70b3-3ef2-44d5-a747-b7ee6d45ea1c req-4bdc3409-0a8b-40e9-a0f0-3ca018250b99 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:47:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0aa70b3-3ef2-44d5-a747-b7ee6d45ea1c req-4bdc3409-0a8b-40e9-a0f0-3ca018250b99 service nova] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:47:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0aa70b3-3ef2-44d5-a747-b7ee6d45ea1c req-4bdc3409-0a8b-40e9-a0f0-3ca018250b99 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] No waiting events found dispatching network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:47:54 user nova-compute[75239]: WARNING nova.compute.manager [req-b0aa70b3-3ef2-44d5-a747-b7ee6d45ea1c req-4bdc3409-0a8b-40e9-a0f0-3ca018250b99 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received unexpected event network-vif-plugged-26feda94-26fa-4eda-b66a-0d3402158d5b for instance with vm_state active and task_state None.
Nov 13 20:47:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:47:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:15 user nova-compute[75239]: INFO nova.compute.manager [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Terminating instance
Nov 13 20:48:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:48:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-4619baf6-8e6d-4201-ab8f-28925c7c8ed4 req-f271d776-7f19-4ade-a67b-bcaa6f6ff2be service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-unplugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4619baf6-8e6d-4201-ab8f-28925c7c8ed4 req-f271d776-7f19-4ade-a67b-bcaa6f6ff2be service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4619baf6-8e6d-4201-ab8f-28925c7c8ed4 req-f271d776-7f19-4ade-a67b-bcaa6f6ff2be service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4619baf6-8e6d-4201-ab8f-28925c7c8ed4 req-f271d776-7f19-4ade-a67b-bcaa6f6ff2be service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-4619baf6-8e6d-4201-ab8f-28925c7c8ed4 req-f271d776-7f19-4ade-a67b-bcaa6f6ff2be service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-unplugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-4619baf6-8e6d-4201-ab8f-28925c7c8ed4 req-f271d776-7f19-4ade-a67b-bcaa6f6ff2be service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-unplugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:48:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Instance destroyed successfully.
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.objects.instance [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lazy-loading 'resources' on Instance uuid e92c1cc5-07e5-4bd2-8e58-e397e16b1300 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:39:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-16569669',display_name='tempest-ServerActionsTestOtherB-server-16569669',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-16569669',id=22,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3cgFTuxZU0r1DOz9OMgd6sE59YAs74F2EMnqYDQDB93Sr2devQa1xYepd0PJ2KrqjVYzoEFlJaWxo0ebxb5mBVEX1HkJ8Mn4KaHB/8mBjirpfPmOT2iYwed690kLau+A==',key_name='tempest-keypair-1787385900',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4d33674f2f4221a2a17f5510135ba8',ramdisk_id='',reservation_id='r-cxa24fp9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-94146296',owner_user_name='tempest-ServerActionsTestOtherB-94146296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c880ecddd16344ae92fdd8916db586d5',uuid=e92c1cc5-07e5-4bd2-8e58-e397e16b1300,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converting VIF {"id": "112c3460-96e2-4760-b161-d7a6fd9b3535", "address": "fa:16:3e:13:86:a6", "network": {"id": "a93e83fa-5b9d-48de-90cd-3237e2f7d2ae", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1607150608-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4d33674f2f4221a2a17f5510135ba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap112c3460-96", "ovs_interfaceid": "112c3460-96e2-4760-b161-d7a6fd9b3535", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_vif [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap112c3460-96, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09627da5-36bb-4cff-b3a8-bf1e81e7fbd9) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:16 user nova-compute[75239]: INFO os_vif [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:86:a6,bridge_name='br-int',has_traffic_filtering=True,id=112c3460-96e2-4760-b161-d7a6fd9b3535,network=Network(a93e83fa-5b9d-48de-90cd-3237e2f7d2ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap112c3460-96')
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrmTOSFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:48:16 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4405709b-ea28-4ae8-9067-3052298f72dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:48:16 user nova-compute[75239]: No targets found.
Nov 13 20:48:16 user nova-compute[75239]: iSNS:
Nov 13 20:48:16 user nova-compute[75239]: No targets found.
Nov 13 20:48:16 user nova-compute[75239]: STATIC:
Nov 13 20:48:16 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:48:16 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:48:16 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:48:16 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:48:16 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:48:16 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:48:16 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:48:16 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:48:16 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:48:16 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b
Nov 13 20:48:16 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:48:16 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:48:16 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c
Nov 13 20:48:16 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:48:16 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:48:16 user nova-compute[75239]: FIRMWARE:
Nov 13 20:48:16 user nova-compute[75239]: No targets found.
Nov 13 20:48:16 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:48:16 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:48:16 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1dbfe1-8ba7-44c1-a5d9-c1ed6ea98759]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[183fd5bd-5eb3-45a4-b105-8fa5a37012be]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:48:16 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:48:16 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:48:16 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:48:16 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:48:16 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:48:16 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:48:16 user nova-compute[75239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b (non-flash)
Nov 13 20:48:16 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:48:16 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:48:16 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60415240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b'): ({'sdi'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Removing single pathed devices sdi {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d22bec7-e457-47c0-a81d-f1ddee528504]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f0602-6340-4110-b40e-847485c8a923]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Flushing IO for device /dev/sdi {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cb4d29-1410-4cdb-b2c9-f753fe0417c2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6b729-750d-4bc7-91fb-88d7322aa3f1]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] SCSI volumes sdi have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d821e46-3ac7-489c-9bb8-a272d791e967]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa51c52-750f-4cb8-b755-276c99793a34]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260]
Nov 13 20:48:16 user nova-compute[75239]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b, portal: 172.16.0.220,3260] successful.
Nov 13 20:48:16 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b50271f-67dd-4e52-8842-19f690a4cd9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e9a0eb-6040-46da-8f4b-fcd4d96179de]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] <== disconnect_volume: return (306ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:48:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Deleting instance files /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300_del
Nov 13 20:48:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Deletion of /opt/stack/data/nova/instances/e92c1cc5-07e5-4bd2-8e58-e397e16b1300_del complete
Nov 13 20:48:16 user nova-compute[75239]: INFO nova.compute.manager [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 13 20:48:16 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:48:16 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:48:17 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:48:17 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Took 0.65 seconds to deallocate network for instance.
Nov 13 20:48:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-5797ce44-4edb-4d80-a274-cd69f9924bf2 req-a328b64b-2c39-4d08-b0ec-8ba117a383f1 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-deleted-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:48:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:18 user nova-compute[75239]: INFO nova.compute.manager [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Took 0.71 seconds to detach 1 volumes for instance.
Nov 13 20:48:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-56e28060-b286-4861-8488-e25a2e723b90 req-724196c9-5989-48b3-83cc-07a58990f8f6 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:48:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-56e28060-b286-4861-8488-e25a2e723b90 req-724196c9-5989-48b3-83cc-07a58990f8f6 service nova] Acquiring lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-56e28060-b286-4861-8488-e25a2e723b90 req-724196c9-5989-48b3-83cc-07a58990f8f6 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-56e28060-b286-4861-8488-e25a2e723b90 req-724196c9-5989-48b3-83cc-07a58990f8f6 service nova] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-56e28060-b286-4861-8488-e25a2e723b90 req-724196c9-5989-48b3-83cc-07a58990f8f6 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] No waiting events found dispatching network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:48:18 user nova-compute[75239]: WARNING nova.compute.manager [req-56e28060-b286-4861-8488-e25a2e723b90 req-724196c9-5989-48b3-83cc-07a58990f8f6 service nova] [instance: e92c1cc5-07e5-4bd2-8e58-e397e16b1300] Received unexpected event network-vif-plugged-112c3460-96e2-4760-b161-d7a6fd9b3535 for instance with vm_state active and task_state deleting.
Nov 13 20:48:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:18 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:48:18 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:48:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:18 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Deleted allocations for instance e92c1cc5-07e5-4bd2-8e58-e397e16b1300
Nov 13 20:48:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eb2c6d22-dd0a-48f6-8836-01eb56f478e7 tempest-ServerActionsTestOtherB-94146296 tempest-ServerActionsTestOtherB-94146296-project-member] Lock "e92c1cc5-07e5-4bd2-8e58-e397e16b1300" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.137s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:33 user nova-compute[75239]: INFO nova.compute.manager [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Terminating instance
Nov 13 20:48:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG nova.compute.manager [req-dca2b7b0-2388-4ec4-904f-dd14c46a7316 req-c6189c09-dc10-44ab-ace1-6c9d9082c37b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-unplugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dca2b7b0-2388-4ec4-904f-dd14c46a7316 req-c6189c09-dc10-44ab-ace1-6c9d9082c37b service nova] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dca2b7b0-2388-4ec4-904f-dd14c46a7316 req-c6189c09-dc10-44ab-ace1-6c9d9082c37b service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dca2b7b0-2388-4ec4-904f-dd14c46a7316 req-c6189c09-dc10-44ab-ace1-6c9d9082c37b service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG nova.compute.manager [req-dca2b7b0-2388-4ec4-904f-dd14c46a7316 req-c6189c09-dc10-44ab-ace1-6c9d9082c37b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] No waiting events found dispatching network-vif-unplugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG nova.compute.manager [req-dca2b7b0-2388-4ec4-904f-dd14c46a7316 req-c6189c09-dc10-44ab-ace1-6c9d9082c37b service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-unplugged-0be4f3e6-716b-4a52-b027-5a84d8415292 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Instance destroyed successfully.
Nov 13 20:48:34 user nova-compute[75239]: DEBUG nova.objects.instance [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lazy-loading 'resources' on Instance uuid 7525c321-c164-4d14-8364-23f07eb826b6 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T20:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1053010473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1053010473',id=28,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1MUOZJC1PwkWhvuRjvIe4l97M8X+mJObuO0KnCNwUZy+BooepOOUP+DTeLCizOjuaf8v86GPelp+OBYk6AdkhvEu/Ve/cqycjHiSR/O3kYCZ3UNQiwFXuMbBvSW/oGWQ==',key_name='tempest-keypair-452032804',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:46:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2d28d93b700143a988524063d92a102a',ramdisk_id='',reservation_id='r-fffww73p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-2022096331',owner_user_name='tempest-AttachVolumeShelveTestJSON-2022096331-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:46:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21fc417bc25944ffb15dd30f9d7f0760',uuid=7525c321-c164-4d14-8364-23f07eb826b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converting VIF {"id": "0be4f3e6-716b-4a52-b027-5a84d8415292", "address": "fa:16:3e:24:10:3f", "network": {"id": "8e96210b-877d-4eed-807e-bb5d68c2eef0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1906793194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2d28d93b700143a988524063d92a102a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0be4f3e6-71", "ovs_interfaceid": "0be4f3e6-716b-4a52-b027-5a84d8415292", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG os_vif [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0be4f3e6-71, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36c902a4-133b-4978-be6c-190ff390e378) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:48:34 user nova-compute[75239]: INFO os_vif [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:10:3f,bridge_name='br-int',has_traffic_filtering=True,id=0be4f3e6-716b-4a52-b027-5a84d8415292,network=Network(8e96210b-877d-4eed-807e-bb5d68c2eef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0be4f3e6-71')
Nov 13 20:48:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Deleting instance files /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6_del
Nov 13 20:48:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Deletion of /opt/stack/data/nova/instances/7525c321-c164-4d14-8364-23f07eb826b6_del complete
Nov 13 20:48:34 user nova-compute[75239]: INFO nova.compute.manager [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 20:48:34 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:48:34 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:48:35 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Took 0.59 seconds to deallocate network for instance.
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-e16bdeab-204e-49c7-bfb6-8107118c8231 req-54e9ee62-de1a-417e-8e7b-48242dc3f66c service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-deleted-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:48:35 user nova-compute[75239]: INFO nova.compute.manager [req-e16bdeab-204e-49c7-bfb6-8107118c8231 req-54e9ee62-de1a-417e-8e7b-48242dc3f66c service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Neutron deleted interface 0be4f3e6-716b-4a52-b027-5a84d8415292; detaching it from the instance and deleting it from the info cache
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.network.neutron [req-e16bdeab-204e-49c7-bfb6-8107118c8231 req-54e9ee62-de1a-417e-8e7b-48242dc3f66c service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-e16bdeab-204e-49c7-bfb6-8107118c8231 req-54e9ee62-de1a-417e-8e7b-48242dc3f66c service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Detach interface failed, port_id=0be4f3e6-716b-4a52-b027-5a84d8415292, reason: Instance 7525c321-c164-4d14-8364-23f07eb826b6 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:48:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.648s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:35 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Deleted allocations for instance 7525c321-c164-4d14-8364-23f07eb826b6
Nov 13 20:48:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-730623d4-e99e-4d0a-b21c-7d1c9a96f4ea tempest-AttachVolumeShelveTestJSON-2022096331 tempest-AttachVolumeShelveTestJSON-2022096331-project-member] Lock "7525c321-c164-4d14-8364-23f07eb826b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.272s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-f0b121d9-cf4a-468f-9f2a-95aee19a3e87 req-829bad77-299e-4637-b938-7374b9f8770d service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:48:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f0b121d9-cf4a-468f-9f2a-95aee19a3e87 req-829bad77-299e-4637-b938-7374b9f8770d service nova] Acquiring lock "7525c321-c164-4d14-8364-23f07eb826b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f0b121d9-cf4a-468f-9f2a-95aee19a3e87 req-829bad77-299e-4637-b938-7374b9f8770d service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f0b121d9-cf4a-468f-9f2a-95aee19a3e87 req-829bad77-299e-4637-b938-7374b9f8770d service nova] Lock "7525c321-c164-4d14-8364-23f07eb826b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-f0b121d9-cf4a-468f-9f2a-95aee19a3e87 req-829bad77-299e-4637-b938-7374b9f8770d service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] No waiting events found dispatching network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:48:36 user nova-compute[75239]: WARNING nova.compute.manager [req-f0b121d9-cf4a-468f-9f2a-95aee19a3e87 req-829bad77-299e-4637-b938-7374b9f8770d service nova] [instance: 7525c321-c164-4d14-8364-23f07eb826b6] Received unexpected event network-vif-plugged-0be4f3e6-716b-4a52-b027-5a84d8415292 for instance with vm_state deleted and task_state None.
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:48:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:48:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7527MB free_disk=24.670055389404297GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 0ba53275-7df4-4ecf-a4cc-860975b83d5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a9ed319e-d732-4930-89b4-7a61ea6cf930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e62931e3-90bb-4959-825c-e80dfc391989 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 518c0f36-dfaa-4e63-808c-dbccbba06d1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 20:48:41 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updating instance_info_cache with network_info: [{"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-1796f4bf-40b0-4a4a-85a5-3690fb761031" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 20:48:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:48:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:48:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:53 user nova-compute[75239]: DEBUG nova.objects.instance [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'flavor' on Instance uuid be0bf428-fadf-4e08-87ac-9563fb31d1b8 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.338s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:48:54 user nova-compute[75239]: INFO nova.compute.manager [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Attaching volume 67298ef5-dae6-42a3-b16d-883720ab51e8 to /dev/vdb
Nov 13 20:48:54 user nova-compute[75239]: DEBUG os_brick.utils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2df46d-92dc-44e2-9c00-177751b13c09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[998c5f46-fb62-4b78-9fad-9753f49147d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[159aa2f0-a717-47a7-9391-df76ab4ec5e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a21f92c-bc83-4b9e-9657-0d766c0e89e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:48:54 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:48:54 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e65310d-dfb5-4deb-b21d-ce43ec291627]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG os_brick.utils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updating existing volume attachment record: 2586c2f3-e643-4ad2-ab9a-d80ceeef5c32 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:48:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MpaLemSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:48:58 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:48:58 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:48:58 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76593d1c-7575-4af8-aae2-af70d185d966]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:48:58 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f345bc25-90f9-4740-8e86-cf8b8372782b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8] added
Nov 13 20:48:58 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[903cdf29-4617-4590-bb33-28cf58a1369b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5674ce74-21cc-4f8b-89ff-998215672fcd]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MpaLemSq {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MpaLemSq" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af1b0f6-4d79-48dd-9f87-d0409642f428]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MpaLemSq'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4aabcf-48dd-4d17-8755-c9e969e2644f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdbb639-ca37-4650-b1d0-07f0b59cfca1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:48:58 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:48:58 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c1581a-8ec1-40cd-9a2a-03b56d7198c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8, portal: 172.16.0.220,3260]
Nov 13 20:48:58 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8, portal: 172.16.0.220,3260] successful.
Nov 13 20:48:58 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5f1ab1-0263-4c91-8cf6-1b7569b2c048]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9357af30-437d-47b5-89ea-a85eb5861032]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:48:58 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:48:58 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:48:58 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f1f12d-0884-4829-8e0c-5b3ba5d1cc4e]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:48:58 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MpaLemSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:48:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:48:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:48:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23163613763323235', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:48:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163613763323235', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:48:59 user nova-compute[75239]: DEBUG nova.objects.instance [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'flavor' on Instance uuid be0bf428-fadf-4e08-87ac-9563fb31d1b8 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:48:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:48:59 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:48:59 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:48:59 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:48:59 user nova-compute[75239]:   <serial>67298ef5-dae6-42a3-b16d-883720ab51e8</serial>
Nov 13 20:48:59 user nova-compute[75239]: </disk>
Nov 13 20:48:59 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:49:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:49:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:49:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] No VIF found with MAC fa:16:3e:1b:9e:7d, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:49:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-942cd263-083f-49ff-9ea3-7e1b137179b9 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.020s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:02 user nova-compute[75239]: DEBUG nova.compute.manager [req-3e6b098a-98f5-49f1-810b-5fc6b370463d req-60fbad69-94ec-4c5c-a999-cb6be0909a5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:02 user nova-compute[75239]: DEBUG nova.compute.manager [req-3e6b098a-98f5-49f1-810b-5fc6b370463d req-60fbad69-94ec-4c5c-a999-cb6be0909a5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing instance network info cache due to event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:49:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3e6b098a-98f5-49f1-810b-5fc6b370463d req-60fbad69-94ec-4c5c-a999-cb6be0909a5f service nova] Acquiring lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:49:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3e6b098a-98f5-49f1-810b-5fc6b370463d req-60fbad69-94ec-4c5c-a999-cb6be0909a5f service nova] Acquired lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:49:02 user nova-compute[75239]: DEBUG nova.network.neutron [req-3e6b098a-98f5-49f1-810b-5fc6b370463d req-60fbad69-94ec-4c5c-a999-cb6be0909a5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:49:02 user nova-compute[75239]: INFO nova.compute.manager [None req-49448c36-d1cd-4273-b7e1-5b2ff184148f tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Unrescuing
Nov 13 20:49:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-49448c36-d1cd-4273-b7e1-5b2ff184148f tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:49:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-49448c36-d1cd-4273-b7e1-5b2ff184148f tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquired lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:49:02 user nova-compute[75239]: DEBUG nova.network.neutron [None req-49448c36-d1cd-4273-b7e1-5b2ff184148f tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.network.neutron [req-3e6b098a-98f5-49f1-810b-5fc6b370463d req-60fbad69-94ec-4c5c-a999-cb6be0909a5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updated VIF entry in instance network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.network.neutron [req-3e6b098a-98f5-49f1-810b-5fc6b370463d req-60fbad69-94ec-4c5c-a999-cb6be0909a5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updating instance_info_cache with network_info: [{"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3e6b098a-98f5-49f1-810b-5fc6b370463d req-60fbad69-94ec-4c5c-a999-cb6be0909a5f service nova] Releasing lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.network.neutron [None req-49448c36-d1cd-4273-b7e1-5b2ff184148f tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-49448c36-d1cd-4273-b7e1-5b2ff184148f tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Releasing lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.objects.instance [None req-49448c36-d1cd-4273-b7e1-5b2ff184148f tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'flavor' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 36c1f1d7-f3f9-4d41-b116-babf44d80f34 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid d816fbc5-c148-472b-9ade-c0175ccb38e0 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid e62931e3-90bb-4959-825c-e80dfc391989 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid be0bf428-fadf-4e08-87ac-9563fb31d1b8 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 518c0f36-dfaa-4e63-808c-dbccbba06d1d {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "e62931e3-90bb-4959-825c-e80dfc391989" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: INFO nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "e62931e3-90bb-4959-825c-e80dfc391989" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance destroyed successfully.
Nov 13 20:49:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-unplugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-unplugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:04 user nova-compute[75239]: WARNING nova.compute.manager [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-unplugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:49:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:04 user nova-compute[75239]: WARNING nova.compute.manager [req-83eee9ce-7861-49ce-b33a-7be280077122 req-051b2335-52ff-427a-8c2f-a2291648b22e service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:49:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-55e08cd0-3c54-4d75-8e54-97725c34cb8d req-816b3189-2850-4712-8b47-fb364613ec5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-55e08cd0-3c54-4d75-8e54-97725c34cb8d req-816b3189-2850-4712-8b47-fb364613ec5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing instance network info cache due to event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-55e08cd0-3c54-4d75-8e54-97725c34cb8d req-816b3189-2850-4712-8b47-fb364613ec5f service nova] Acquiring lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-55e08cd0-3c54-4d75-8e54-97725c34cb8d req-816b3189-2850-4712-8b47-fb364613ec5f service nova] Acquired lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG nova.network.neutron [req-55e08cd0-3c54-4d75-8e54-97725c34cb8d req-816b3189-2850-4712-8b47-fb364613ec5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG nova.network.neutron [req-55e08cd0-3c54-4d75-8e54-97725c34cb8d req-816b3189-2850-4712-8b47-fb364613ec5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updated VIF entry in instance network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG nova.network.neutron [req-55e08cd0-3c54-4d75-8e54-97725c34cb8d req-816b3189-2850-4712-8b47-fb364613ec5f service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updating instance_info_cache with network_info: [{"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-55e08cd0-3c54-4d75-8e54-97725c34cb8d req-816b3189-2850-4712-8b47-fb364613ec5f service nova] Releasing lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:05 user nova-compute[75239]: INFO nova.compute.manager [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Rebooting instance
Nov 13 20:49:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquired lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:49:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updating instance_info_cache with network_info: [{"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Releasing lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:06 user nova-compute[75239]: WARNING nova.compute.manager [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:49:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:06 user nova-compute[75239]: WARNING nova.compute.manager [req-889c5039-175d-4747-bfc1-1d906dc31fbd req-4c8c68f5-b588-48f5-8d7c-bfc07a1e4692 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state rescued and task_state unrescuing.
Nov 13 20:49:07 user nova-compute[75239]: DEBUG nova.compute.manager [None req-49448c36-d1cd-4273-b7e1-5b2ff184148f tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:49:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-e0c313e6-e2af-432c-9156-b02c87712e64 req-ade12e39-2eda-4ea4-88b8-07f043644675 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-vif-unplugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e0c313e6-e2af-432c-9156-b02c87712e64 req-ade12e39-2eda-4ea4-88b8-07f043644675 service nova] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e0c313e6-e2af-432c-9156-b02c87712e64 req-ade12e39-2eda-4ea4-88b8-07f043644675 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e0c313e6-e2af-432c-9156-b02c87712e64 req-ade12e39-2eda-4ea4-88b8-07f043644675 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-e0c313e6-e2af-432c-9156-b02c87712e64 req-ade12e39-2eda-4ea4-88b8-07f043644675 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] No waiting events found dispatching network-vif-unplugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:09 user nova-compute[75239]: WARNING nova.compute.manager [req-e0c313e6-e2af-432c-9156-b02c87712e64 req-ade12e39-2eda-4ea4-88b8-07f043644675 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received unexpected event network-vif-unplugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 for instance with vm_state active and task_state reboot_started.
Nov 13 20:49:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Instance shutdown successfully.
Nov 13 20:49:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-39e9f511-8b55-4cc4-8d84-1e974793cf64 req-61620103-2e8c-43bf-b124-4fd5e330d637 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-39e9f511-8b55-4cc4-8d84-1e974793cf64 req-61620103-2e8c-43bf-b124-4fd5e330d637 service nova] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-39e9f511-8b55-4cc4-8d84-1e974793cf64 req-61620103-2e8c-43bf-b124-4fd5e330d637 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-39e9f511-8b55-4cc4-8d84-1e974793cf64 req-61620103-2e8c-43bf-b124-4fd5e330d637 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-39e9f511-8b55-4cc4-8d84-1e974793cf64 req-61620103-2e8c-43bf-b124-4fd5e330d637 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] No waiting events found dispatching network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:11 user nova-compute[75239]: WARNING nova.compute.manager [req-39e9f511-8b55-4cc4-8d84-1e974793cf64 req-61620103-2e8c-43bf-b124-4fd5e330d637 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received unexpected event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 for instance with vm_state active and task_state reboot_started.
Nov 13 20:49:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] No waiting events found dispatching network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:13 user nova-compute[75239]: WARNING nova.compute.manager [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received unexpected event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 for instance with vm_state active and task_state reboot_started.
Nov 13 20:49:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG nova.compute.manager [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] No waiting events found dispatching network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:13 user nova-compute[75239]: WARNING nova.compute.manager [req-9d5e5d50-84c9-49e7-b787-cb43041cb517 req-7799d50f-62a3-494a-8a44-52fc7578e2cc service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received unexpected event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 for instance with vm_state active and task_state reboot_started.
Nov 13 20:49:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Instance running successfully.
Nov 13 20:49:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Instance soft rebooted successfully.
Nov 13 20:49:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:49:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6ac9c32c-8ded-46d7-8cd3-eb2192287751 tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.677s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:31 user nova-compute[75239]: INFO nova.compute.manager [None req-1140ccfb-02ed-4af6-be96-7021ad5e1342 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Get console output
Nov 13 20:49:31 user nova-compute[75239]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 13 20:49:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:34 user nova-compute[75239]: INFO nova.compute.manager [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Terminating instance
Nov 13 20:49:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-d872e316-b3f4-4144-9b83-8f50546db6f9 req-187b26de-b983-4b06-882e-5a8cd893826a service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received event network-vif-unplugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d872e316-b3f4-4144-9b83-8f50546db6f9 req-187b26de-b983-4b06-882e-5a8cd893826a service nova] Acquiring lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d872e316-b3f4-4144-9b83-8f50546db6f9 req-187b26de-b983-4b06-882e-5a8cd893826a service nova] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d872e316-b3f4-4144-9b83-8f50546db6f9 req-187b26de-b983-4b06-882e-5a8cd893826a service nova] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-d872e316-b3f4-4144-9b83-8f50546db6f9 req-187b26de-b983-4b06-882e-5a8cd893826a service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] No waiting events found dispatching network-vif-unplugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-d872e316-b3f4-4144-9b83-8f50546db6f9 req-187b26de-b983-4b06-882e-5a8cd893826a service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received event network-vif-unplugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:49:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Instance destroyed successfully.
Nov 13 20:49:35 user nova-compute[75239]: DEBUG nova.objects.instance [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lazy-loading 'resources' on Instance uuid 518c0f36-dfaa-4e63-808c-dbccbba06d1d {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-318872119',display_name='tempest-VolumesActionsTest-instance-318872119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-318872119',id=34,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:47:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc2074bf752f49f58f8ccc88a33b6309',ramdisk_id='',reservation_id='r-nvtm8xi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1662331085',owner_user_name='tempest-VolumesActionsTest-1662331085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:47:51Z,user_data=None,user_id='8b99b7e2d05b45b3855c6d4debeb46a2',uuid=518c0f36-dfaa-4e63-808c-dbccbba06d1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converting VIF {"id": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "address": "fa:16:3e:40:1e:31", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7a2ce1-1a", "ovs_interfaceid": "8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:1e:31,bridge_name='br-int',has_traffic_filtering=True,id=8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a2ce1-1a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG os_vif [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:1e:31,bridge_name='br-int',has_traffic_filtering=True,id=8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a2ce1-1a') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c7a2ce1-1a, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9f4b973-54e6-479e-a2ee-1e607f5c1084) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:49:35 user nova-compute[75239]: INFO os_vif [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:1e:31,bridge_name='br-int',has_traffic_filtering=True,id=8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7a2ce1-1a')
Nov 13 20:49:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Deleting instance files /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d_del
Nov 13 20:49:35 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Deletion of /opt/stack/data/nova/instances/518c0f36-dfaa-4e63-808c-dbccbba06d1d_del complete
Nov 13 20:49:35 user nova-compute[75239]: INFO nova.compute.manager [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 13 20:49:35 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:49:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:36 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:36 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Took 1.27 seconds to deallocate network for instance.
Nov 13 20:49:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-2b60797b-34d0-4757-915d-c41539342928 req-d69f8e6a-55a6-498f-8cf6-177ac86bfa64 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received event network-vif-deleted-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:36 user nova-compute[75239]: INFO nova.compute.manager [req-2b60797b-34d0-4757-915d-c41539342928 req-d69f8e6a-55a6-498f-8cf6-177ac86bfa64 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Neutron deleted interface 8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b; detaching it from the instance and deleting it from the info cache
Nov 13 20:49:36 user nova-compute[75239]: DEBUG nova.network.neutron [req-2b60797b-34d0-4757-915d-c41539342928 req-d69f8e6a-55a6-498f-8cf6-177ac86bfa64 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-2b60797b-34d0-4757-915d-c41539342928 req-d69f8e6a-55a6-498f-8cf6-177ac86bfa64 service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Detach interface failed, port_id=8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b, reason: Instance 518c0f36-dfaa-4e63-808c-dbccbba06d1d could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-1bf36b22-10ef-44af-b245-a6e469c2645a req-8e4f3c4d-344f-4d0b-9b38-11cc5d277d5c service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received event network-vif-plugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1bf36b22-10ef-44af-b245-a6e469c2645a req-8e4f3c4d-344f-4d0b-9b38-11cc5d277d5c service nova] Acquiring lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1bf36b22-10ef-44af-b245-a6e469c2645a req-8e4f3c4d-344f-4d0b-9b38-11cc5d277d5c service nova] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1bf36b22-10ef-44af-b245-a6e469c2645a req-8e4f3c4d-344f-4d0b-9b38-11cc5d277d5c service nova] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-1bf36b22-10ef-44af-b245-a6e469c2645a req-8e4f3c4d-344f-4d0b-9b38-11cc5d277d5c service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] No waiting events found dispatching network-vif-plugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:37 user nova-compute[75239]: WARNING nova.compute.manager [req-1bf36b22-10ef-44af-b245-a6e469c2645a req-8e4f3c4d-344f-4d0b-9b38-11cc5d277d5c service nova] [instance: 518c0f36-dfaa-4e63-808c-dbccbba06d1d] Received unexpected event network-vif-plugged-8c7a2ce1-1a7f-4509-85e7-e96ef4199c8b for instance with vm_state deleted and task_state None.
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.121s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:49:37 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Deleted allocations for instance 518c0f36-dfaa-4e63-808c-dbccbba06d1d
Nov 13 20:49:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-170262cd-9dd0-4af5-a7a1-2129d09c598d tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "518c0f36-dfaa-4e63-808c-dbccbba06d1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.747s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:49:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:40 user nova-compute[75239]: INFO nova.compute.manager [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Terminating instance
Nov 13 20:49:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:49:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:49:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7766MB free_disk=24.68478775024414GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Instance destroyed successfully.
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.objects.instance [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'resources' on Instance uuid 0ba53275-7df4-4ecf-a4cc-860975b83d5f {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:44:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1592386908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1592386908',id=31,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:46:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-5jmj3d54',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:47:54Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=0ba53275-7df4-4ecf-a4cc-860975b83d5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "26feda94-26fa-4eda-b66a-0d3402158d5b", "address": "fa:16:3e:86:2f:80", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26feda94-26", "ovs_interfaceid": "26feda94-26fa-4eda-b66a-0d3402158d5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:2f:80,bridge_name='br-int',has_traffic_filtering=True,id=26feda94-26fa-4eda-b66a-0d3402158d5b,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26feda94-26') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_vif [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:2f:80,bridge_name='br-int',has_traffic_filtering=True,id=26feda94-26fa-4eda-b66a-0d3402158d5b,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26feda94-26') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26feda94-26, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f17d8f78-4aea-4688-8ab6-ca0456b2e1b4) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:41 user nova-compute[75239]: INFO os_vif [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:2f:80,bridge_name='br-int',has_traffic_filtering=True,id=26feda94-26fa-4eda-b66a-0d3402158d5b,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26feda94-26')
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SxrEQtas', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:49:41 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceb7736-e42d-4ed0-a397-8eb9b0fe86f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:49:41 user nova-compute[75239]: No targets found.
Nov 13 20:49:41 user nova-compute[75239]: iSNS:
Nov 13 20:49:41 user nova-compute[75239]: No targets found.
Nov 13 20:49:41 user nova-compute[75239]: STATIC:
Nov 13 20:49:41 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:49:41 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:49:41 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:49:41 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:49:41 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:49:41 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:49:41 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8
Nov 13 20:49:41 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:49:41 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:49:41 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d
Nov 13 20:49:41 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:49:41 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:49:41 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c
Nov 13 20:49:41 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:49:41 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:49:41 user nova-compute[75239]: FIRMWARE:
Nov 13 20:49:41 user nova-compute[75239]: No targets found.
Nov 13 20:49:41 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:49:41 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:49:41 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1dbe65-17be-4ab7-808e-1ac3f8855798]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[055c1ec8-e482-4287-a60e-36866913835f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:49:41 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:49:41 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:49:41 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:49:41 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:49:41 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:49:41 user nova-compute[75239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d (non-flash)
Nov 13 20:49:41 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:49:41 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:49:41 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:49:41 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d846e9bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d'): ({'sdf'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Removing single pathed devices sdf {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 0ba53275-7df4-4ecf-a4cc-860975b83d5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a9ed319e-d732-4930-89b4-7a61ea6cf930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e62931e3-90bb-4959-825c-e80dfc391989 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd2c59c-22e3-47f8-920d-99fe4ccdad7c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ff30cb-8299-46f0-9888-2e48412630a4]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flushing IO for device /dev/sdf {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[63065b5c-97d4-47da-ac85-b43b60fd0235]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fd0ab3-0ceb-4134-b3c2-3b1d21d15274]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] SCSI volumes sdf have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49f02c1-ad09-48b5-bdee-612b2ea3a466]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ddad00-5d70-4776-8ab7-b95cc1f44e09]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d, portal: 172.16.0.220,3260]
Nov 13 20:49:41 user nova-compute[75239]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d, portal: 172.16.0.220,3260] successful.
Nov 13 20:49:41 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78bb4404-70be-4898-aae4-a63902fa601d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8329947-b193-4ee4-884e-6e2f1b02df70]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] <== disconnect_volume: return (317ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:49:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:49:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Deleting instance files /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f_del
Nov 13 20:49:41 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Deletion of /opt/stack/data/nova/instances/0ba53275-7df4-4ecf-a4cc-860975b83d5f_del complete
Nov 13 20:49:42 user nova-compute[75239]: INFO nova.compute.manager [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Took 1.56 seconds to destroy the instance on the hypervisor.
Nov 13 20:49:42 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.556s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.534s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:49:42 user nova-compute[75239]: INFO nova.compute.claims [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Claim successful on node user
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-7cec1f21-f54b-455f-b996-1dfddac6b161 req-b715dbdf-d09b-4f3a-8103-7cc054c63953 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Received event network-vif-deleted-26feda94-26fa-4eda-b66a-0d3402158d5b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:42 user nova-compute[75239]: INFO nova.compute.manager [req-7cec1f21-f54b-455f-b996-1dfddac6b161 req-b715dbdf-d09b-4f3a-8103-7cc054c63953 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Neutron deleted interface 26feda94-26fa-4eda-b66a-0d3402158d5b; detaching it from the instance and deleting it from the info cache
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-7cec1f21-f54b-455f-b996-1dfddac6b161 req-b715dbdf-d09b-4f3a-8103-7cc054c63953 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:42 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Took 0.49 seconds to deallocate network for instance.
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-7cec1f21-f54b-455f-b996-1dfddac6b161 req-b715dbdf-d09b-4f3a-8103-7cc054c63953 service nova] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Detach interface failed, port_id=26feda94-26fa-4eda-b66a-0d3402158d5b, reason: Instance 0ba53275-7df4-4ecf-a4cc-860975b83d5f could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:49:42 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.policy [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa7ce2c9a26e403d9d802d354b43e8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f422c15f5d0d4a62ad37feabca7faa03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:49:42 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Creating image(s)
Nov 13 20:49:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "/opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "/opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "/opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk 1073741824" returned: 0 in 0.057s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Successfully created port: cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.192s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Cannot resize image /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Ensure instance console log exists: /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:43 user nova-compute[75239]: INFO nova.compute.manager [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 0ba53275-7df4-4ecf-a4cc-860975b83d5f] Took 1.25 seconds to detach 1 volumes for instance.
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Successfully updated port: cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquired lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:44 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Deleted allocations for instance 0ba53275-7df4-4ecf-a4cc-860975b83d5f
Nov 13 20:49:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-eeaa8613-2148-4e13-a9a0-9e951a42e4b0 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "0ba53275-7df4-4ecf-a4cc-860975b83d5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.859s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Updating instance_info_cache with network_info: [{"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Releasing lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Instance network_info: |[{"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Start _get_guest_xml network_info=[{"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:49:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:49:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-187280661',display_name='tempest-AttachVolumeNegativeTest-server-187280661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-187280661',id=35,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDqpIXkhSbfpjtpk9hLOJzTgZ0v2MINy2kx2o8Yt45HF42sFpMMiYqu1EBu68v5VfcaczxV8PSou5u+l1hXoOBjsTepLhp7EXtBvK66UrBGIIyfF+VL3HIGeQTKXnvUZA==',key_name='tempest-keypair-188463361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-m471xd2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=4db9d6bf-a3f0-4495-af7c-272e74e34324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=cadda64b-9f2a-4646-ab61-aa289f7809b3,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadda64b-9f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.objects.instance [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'pci_devices' on Instance uuid 4db9d6bf-a3f0-4495-af7c-272e74e34324 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:49:44 user nova-compute[75239]:   <uuid>4db9d6bf-a3f0-4495-af7c-272e74e34324</uuid>
Nov 13 20:49:44 user nova-compute[75239]:   <name>instance-00000023</name>
Nov 13 20:49:44 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:49:44 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:49:44 user nova-compute[75239]:   <metadata>
Nov 13 20:49:44 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:49:44 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:49:44 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeNegativeTest-server-187280661</nova:name>
Nov 13 20:49:44 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:49:44</nova:creationTime>
Nov 13 20:49:44 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:49:44 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:49:44 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:49:44 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:49:44 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:49:44 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:49:44 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:49:44 user nova-compute[75239]:       <nova:owner>
Nov 13 20:49:44 user nova-compute[75239]:         <nova:user uuid="fa7ce2c9a26e403d9d802d354b43e8e7">tempest-AttachVolumeNegativeTest-1236383897-project-member</nova:user>
Nov 13 20:49:44 user nova-compute[75239]:         <nova:project uuid="f422c15f5d0d4a62ad37feabca7faa03">tempest-AttachVolumeNegativeTest-1236383897</nova:project>
Nov 13 20:49:44 user nova-compute[75239]:       </nova:owner>
Nov 13 20:49:44 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:49:44 user nova-compute[75239]:       <nova:ports>
Nov 13 20:49:44 user nova-compute[75239]:         <nova:port uuid="cadda64b-9f2a-4646-ab61-aa289f7809b3">
Nov 13 20:49:44 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 20:49:44 user nova-compute[75239]:         </nova:port>
Nov 13 20:49:44 user nova-compute[75239]:       </nova:ports>
Nov 13 20:49:44 user nova-compute[75239]:     </nova:instance>
Nov 13 20:49:44 user nova-compute[75239]:   </metadata>
Nov 13 20:49:44 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:49:44 user nova-compute[75239]:     <system>
Nov 13 20:49:44 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:49:44 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:49:44 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:49:44 user nova-compute[75239]:       <entry name="serial">4db9d6bf-a3f0-4495-af7c-272e74e34324</entry>
Nov 13 20:49:44 user nova-compute[75239]:       <entry name="uuid">4db9d6bf-a3f0-4495-af7c-272e74e34324</entry>
Nov 13 20:49:44 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:49:44 user nova-compute[75239]:     </system>
Nov 13 20:49:44 user nova-compute[75239]:   </sysinfo>
Nov 13 20:49:44 user nova-compute[75239]:   <os>
Nov 13 20:49:44 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:49:44 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:49:44 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:49:44 user nova-compute[75239]:   </os>
Nov 13 20:49:44 user nova-compute[75239]:   <features>
Nov 13 20:49:44 user nova-compute[75239]:     <acpi/>
Nov 13 20:49:44 user nova-compute[75239]:     <apic/>
Nov 13 20:49:44 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:49:44 user nova-compute[75239]:   </features>
Nov 13 20:49:44 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:49:44 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:49:44 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:49:44 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:49:44 user nova-compute[75239]:   </clock>
Nov 13 20:49:44 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:49:44 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:49:44 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:49:44 user nova-compute[75239]:   </cpu>
Nov 13 20:49:44 user nova-compute[75239]:   <devices>
Nov 13 20:49:44 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:49:44 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:49:44 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk"/>
Nov 13 20:49:44 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:49:44 user nova-compute[75239]:     </disk>
Nov 13 20:49:44 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:49:44 user nova-compute[75239]:       <mac address="fa:16:3e:92:30:7d"/>
Nov 13 20:49:44 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:49:44 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:49:44 user nova-compute[75239]:       <target dev="tapcadda64b-9f"/>
Nov 13 20:49:44 user nova-compute[75239]:     </interface>
Nov 13 20:49:44 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:49:44 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/console.log" append="off"/>
Nov 13 20:49:44 user nova-compute[75239]:     </serial>
Nov 13 20:49:44 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:49:44 user nova-compute[75239]:     <video>
Nov 13 20:49:44 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:49:44 user nova-compute[75239]:     </video>
Nov 13 20:49:44 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:49:44 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:49:44 user nova-compute[75239]:     </rng>
Nov 13 20:49:44 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:49:44 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:49:44 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:49:44 user nova-compute[75239]:     </memballoon>
Nov 13 20:49:44 user nova-compute[75239]:   </devices>
Nov 13 20:49:44 user nova-compute[75239]: </domain>
Nov 13 20:49:44 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-187280661',display_name='tempest-AttachVolumeNegativeTest-server-187280661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-187280661',id=35,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDqpIXkhSbfpjtpk9hLOJzTgZ0v2MINy2kx2o8Yt45HF42sFpMMiYqu1EBu68v5VfcaczxV8PSou5u+l1hXoOBjsTepLhp7EXtBvK66UrBGIIyfF+VL3HIGeQTKXnvUZA==',key_name='tempest-keypair-188463361',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-m471xd2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=4db9d6bf-a3f0-4495-af7c-272e74e34324,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=cadda64b-9f2a-4646-ab61-aa289f7809b3,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadda64b-9f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG os_vif [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=cadda64b-9f2a-4646-ab61-aa289f7809b3,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadda64b-9f') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bfef8e7-fa22-53eb-9cf9-817a77d80ba2', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcadda64b-9f, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcadda64b-9f, col_values=(('qos', UUID('9b0c3ff9-d31c-47f2-b74b-5aafc055dddd')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcadda64b-9f, col_values=(('external_ids', {'iface-id': 'cadda64b-9f2a-4646-ab61-aa289f7809b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:30:7d', 'vm-uuid': '4db9d6bf-a3f0-4495-af7c-272e74e34324'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-3e3dad1a-c5f9-446d-8338-f6c421944458 req-c279b063-15ca-49b4-884e-6140424d3841 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received event network-changed-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-3e3dad1a-c5f9-446d-8338-f6c421944458 req-c279b063-15ca-49b4-884e-6140424d3841 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Refreshing instance network info cache due to event network-changed-cadda64b-9f2a-4646-ab61-aa289f7809b3. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3e3dad1a-c5f9-446d-8338-f6c421944458 req-c279b063-15ca-49b4-884e-6140424d3841 service nova] Acquiring lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3e3dad1a-c5f9-446d-8338-f6c421944458 req-c279b063-15ca-49b4-884e-6140424d3841 service nova] Acquired lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-3e3dad1a-c5f9-446d-8338-f6c421944458 req-c279b063-15ca-49b4-884e-6140424d3841 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Refreshing network info cache for port cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:44 user nova-compute[75239]: INFO os_vif [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=cadda64b-9f2a-4646-ab61-aa289f7809b3,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadda64b-9f')
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:49:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No VIF found with MAC fa:16:3e:92:30:7d, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG nova.network.neutron [req-3e3dad1a-c5f9-446d-8338-f6c421944458 req-c279b063-15ca-49b4-884e-6140424d3841 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Updated VIF entry in instance network info cache for port cadda64b-9f2a-4646-ab61-aa289f7809b3. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG nova.network.neutron [req-3e3dad1a-c5f9-446d-8338-f6c421944458 req-c279b063-15ca-49b4-884e-6140424d3841 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Updating instance_info_cache with network_info: [{"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-3e3dad1a-c5f9-446d-8338-f6c421944458 req-c279b063-15ca-49b4-884e-6140424d3841 service nova] Releasing lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG nova.compute.manager [req-0428173c-118c-4cea-b295-58a36a8705d4 req-5e21fddd-02ac-4714-811a-5cc59b3d4ee1 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received event network-vif-plugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0428173c-118c-4cea-b295-58a36a8705d4 req-5e21fddd-02ac-4714-811a-5cc59b3d4ee1 service nova] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0428173c-118c-4cea-b295-58a36a8705d4 req-5e21fddd-02ac-4714-811a-5cc59b3d4ee1 service nova] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0428173c-118c-4cea-b295-58a36a8705d4 req-5e21fddd-02ac-4714-811a-5cc59b3d4ee1 service nova] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG nova.compute.manager [req-0428173c-118c-4cea-b295-58a36a8705d4 req-5e21fddd-02ac-4714-811a-5cc59b3d4ee1 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] No waiting events found dispatching network-vif-plugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:46 user nova-compute[75239]: WARNING nova.compute.manager [req-0428173c-118c-4cea-b295-58a36a8705d4 req-5e21fddd-02ac-4714-811a-5cc59b3d4ee1 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received unexpected event network-vif-plugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 for instance with vm_state building and task_state spawning.
Nov 13 20:49:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updating instance_info_cache with network_info: [{"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-4ca1da31-616b-4f78-b50b-6e58d8d70974" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:49:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:49:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Instance spawned successfully.
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-7d244b23-92e4-42be-b502-307470093bcd req-e7630b2e-2861-4625-a18c-311f3656071f service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received event network-vif-plugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7d244b23-92e4-42be-b502-307470093bcd req-e7630b2e-2861-4625-a18c-311f3656071f service nova] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7d244b23-92e4-42be-b502-307470093bcd req-e7630b2e-2861-4625-a18c-311f3656071f service nova] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7d244b23-92e4-42be-b502-307470093bcd req-e7630b2e-2861-4625-a18c-311f3656071f service nova] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-7d244b23-92e4-42be-b502-307470093bcd req-e7630b2e-2861-4625-a18c-311f3656071f service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] No waiting events found dispatching network-vif-plugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:49:48 user nova-compute[75239]: WARNING nova.compute.manager [req-7d244b23-92e4-42be-b502-307470093bcd req-e7630b2e-2861-4625-a18c-311f3656071f service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received unexpected event network-vif-plugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 for instance with vm_state building and task_state spawning.
Nov 13 20:49:48 user nova-compute[75239]: INFO nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 13 20:49:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:49:48 user nova-compute[75239]: INFO nova.compute.manager [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Took 6.71 seconds to build instance.
Nov 13 20:49:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ea2ca1fa-8a5e-4420-80cd-f801bc327981 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.608s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquiring lock "20af452b-8d73-42f4-8030-b6f488642876" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "20af452b-8d73-42f4-8030-b6f488642876" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:49:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:49:58 user nova-compute[75239]: INFO nova.compute.claims [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Claim successful on node user
Nov 13 20:49:59 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:49:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:49:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG nova.policy [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eea5464c85504c0daa21a5ec35b3a456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78bcf1439e0740b494496ee7d6b303a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:49:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Creating image(s)
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquiring lock "/opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "/opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.009s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "/opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk 1073741824" returned: 0 in 0.060s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:49:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Successfully created port: 4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.221s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Cannot resize image /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Ensure instance console log exists: /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Successfully updated port: 4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquiring lock "refresh_cache-20af452b-8d73-42f4-8030-b6f488642876" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquired lock "refresh_cache-20af452b-8d73-42f4-8030-b6f488642876" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.compute.manager [req-5ed18d35-72da-4f62-a440-fdb78805d6e2 req-9aeacee5-c100-4da6-993d-34a17b033862 service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received event network-changed-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.compute.manager [req-5ed18d35-72da-4f62-a440-fdb78805d6e2 req-9aeacee5-c100-4da6-993d-34a17b033862 service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Refreshing instance network info cache due to event network-changed-4108eedc-7fc3-4282-a085-894876e35493. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5ed18d35-72da-4f62-a440-fdb78805d6e2 req-9aeacee5-c100-4da6-993d-34a17b033862 service nova] Acquiring lock "refresh_cache-20af452b-8d73-42f4-8030-b6f488642876" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:50:00 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Updating instance_info_cache with network_info: [{"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Releasing lock "refresh_cache-20af452b-8d73-42f4-8030-b6f488642876" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Instance network_info: |[{"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5ed18d35-72da-4f62-a440-fdb78805d6e2 req-9aeacee5-c100-4da6-993d-34a17b033862 service nova] Acquired lock "refresh_cache-20af452b-8d73-42f4-8030-b6f488642876" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.network.neutron [req-5ed18d35-72da-4f62-a440-fdb78805d6e2 req-9aeacee5-c100-4da6-993d-34a17b033862 service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Refreshing network info cache for port 4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Start _get_guest_xml network_info=[{"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:50:01 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:50:01 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-61140831',display_name='tempest-VolumesNegativeTest-instance-61140831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-61140831',id=36,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78bcf1439e0740b494496ee7d6b303a1',ramdisk_id='',reservation_id='r-8xnphw03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-53094924',owner_user_name='tempest-VolumesNegativeTest-53094924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:49:59Z,user_data=None,user_id='eea5464c85504c0daa21a5ec35b3a456',uuid=20af452b-8d73-42f4-8030-b6f488642876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Converting VIF {"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=4108eedc-7fc3-4282-a085-894876e35493,network=Network(a64638ab-9dc0-4f12-afef-41dc9593b48d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4108eedc-7f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lazy-loading 'pci_devices' on Instance uuid 20af452b-8d73-42f4-8030-b6f488642876 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:50:01 user nova-compute[75239]:   <uuid>20af452b-8d73-42f4-8030-b6f488642876</uuid>
Nov 13 20:50:01 user nova-compute[75239]:   <name>instance-00000024</name>
Nov 13 20:50:01 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:50:01 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:50:01 user nova-compute[75239]:   <metadata>
Nov 13 20:50:01 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:50:01 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:50:01 user nova-compute[75239]:       <nova:name>tempest-VolumesNegativeTest-instance-61140831</nova:name>
Nov 13 20:50:01 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:50:01</nova:creationTime>
Nov 13 20:50:01 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:50:01 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:50:01 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:50:01 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:50:01 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:50:01 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:50:01 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:50:01 user nova-compute[75239]:       <nova:owner>
Nov 13 20:50:01 user nova-compute[75239]:         <nova:user uuid="eea5464c85504c0daa21a5ec35b3a456">tempest-VolumesNegativeTest-53094924-project-member</nova:user>
Nov 13 20:50:01 user nova-compute[75239]:         <nova:project uuid="78bcf1439e0740b494496ee7d6b303a1">tempest-VolumesNegativeTest-53094924</nova:project>
Nov 13 20:50:01 user nova-compute[75239]:       </nova:owner>
Nov 13 20:50:01 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:50:01 user nova-compute[75239]:       <nova:ports>
Nov 13 20:50:01 user nova-compute[75239]:         <nova:port uuid="4108eedc-7fc3-4282-a085-894876e35493">
Nov 13 20:50:01 user nova-compute[75239]:           <nova:ip type="fixed" address="192.168.233.233" ipVersion="4"/>
Nov 13 20:50:01 user nova-compute[75239]:         </nova:port>
Nov 13 20:50:01 user nova-compute[75239]:       </nova:ports>
Nov 13 20:50:01 user nova-compute[75239]:     </nova:instance>
Nov 13 20:50:01 user nova-compute[75239]:   </metadata>
Nov 13 20:50:01 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:50:01 user nova-compute[75239]:     <system>
Nov 13 20:50:01 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:50:01 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:50:01 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:50:01 user nova-compute[75239]:       <entry name="serial">20af452b-8d73-42f4-8030-b6f488642876</entry>
Nov 13 20:50:01 user nova-compute[75239]:       <entry name="uuid">20af452b-8d73-42f4-8030-b6f488642876</entry>
Nov 13 20:50:01 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:50:01 user nova-compute[75239]:     </system>
Nov 13 20:50:01 user nova-compute[75239]:   </sysinfo>
Nov 13 20:50:01 user nova-compute[75239]:   <os>
Nov 13 20:50:01 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:50:01 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:50:01 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:50:01 user nova-compute[75239]:   </os>
Nov 13 20:50:01 user nova-compute[75239]:   <features>
Nov 13 20:50:01 user nova-compute[75239]:     <acpi/>
Nov 13 20:50:01 user nova-compute[75239]:     <apic/>
Nov 13 20:50:01 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:50:01 user nova-compute[75239]:   </features>
Nov 13 20:50:01 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:50:01 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:50:01 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:50:01 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:50:01 user nova-compute[75239]:   </clock>
Nov 13 20:50:01 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:50:01 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:50:01 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:50:01 user nova-compute[75239]:   </cpu>
Nov 13 20:50:01 user nova-compute[75239]:   <devices>
Nov 13 20:50:01 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:50:01 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:50:01 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk"/>
Nov 13 20:50:01 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:50:01 user nova-compute[75239]:     </disk>
Nov 13 20:50:01 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:50:01 user nova-compute[75239]:       <mac address="fa:16:3e:56:3c:bc"/>
Nov 13 20:50:01 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:50:01 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:50:01 user nova-compute[75239]:       <target dev="tap4108eedc-7f"/>
Nov 13 20:50:01 user nova-compute[75239]:     </interface>
Nov 13 20:50:01 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:50:01 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/console.log" append="off"/>
Nov 13 20:50:01 user nova-compute[75239]:     </serial>
Nov 13 20:50:01 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:50:01 user nova-compute[75239]:     <video>
Nov 13 20:50:01 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:50:01 user nova-compute[75239]:     </video>
Nov 13 20:50:01 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:50:01 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:50:01 user nova-compute[75239]:     </rng>
Nov 13 20:50:01 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:50:01 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:50:01 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:50:01 user nova-compute[75239]:     </memballoon>
Nov 13 20:50:01 user nova-compute[75239]:   </devices>
Nov 13 20:50:01 user nova-compute[75239]: </domain>
Nov 13 20:50:01 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-61140831',display_name='tempest-VolumesNegativeTest-instance-61140831',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-61140831',id=36,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78bcf1439e0740b494496ee7d6b303a1',ramdisk_id='',reservation_id='r-8xnphw03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-53094924',owner_user_name='tempest-VolumesNegativeTest-53094924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:49:59Z,user_data=None,user_id='eea5464c85504c0daa21a5ec35b3a456',uuid=20af452b-8d73-42f4-8030-b6f488642876,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Converting VIF {"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=4108eedc-7fc3-4282-a085-894876e35493,network=Network(a64638ab-9dc0-4f12-afef-41dc9593b48d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4108eedc-7f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG os_vif [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=4108eedc-7fc3-4282-a085-894876e35493,network=Network(a64638ab-9dc0-4f12-afef-41dc9593b48d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4108eedc-7f') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2db9555c-5516-540f-be25-f215ca0ec0dd', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4108eedc-7f, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4108eedc-7f, col_values=(('qos', UUID('33de37ec-7f4a-40e9-ba64-744446ec20c0')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4108eedc-7f, col_values=(('external_ids', {'iface-id': '4108eedc-7fc3-4282-a085-894876e35493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:3c:bc', 'vm-uuid': '20af452b-8d73-42f4-8030-b6f488642876'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:01 user nova-compute[75239]: INFO os_vif [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=4108eedc-7fc3-4282-a085-894876e35493,network=Network(a64638ab-9dc0-4f12-afef-41dc9593b48d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4108eedc-7f')
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] No VIF found with MAC fa:16:3e:56:3c:bc, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.network.neutron [req-5ed18d35-72da-4f62-a440-fdb78805d6e2 req-9aeacee5-c100-4da6-993d-34a17b033862 service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Updated VIF entry in instance network info cache for port 4108eedc-7fc3-4282-a085-894876e35493. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG nova.network.neutron [req-5ed18d35-72da-4f62-a440-fdb78805d6e2 req-9aeacee5-c100-4da6-993d-34a17b033862 service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Updating instance_info_cache with network_info: [{"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5ed18d35-72da-4f62-a440-fdb78805d6e2 req-9aeacee5-c100-4da6-993d-34a17b033862 service nova] Releasing lock "refresh_cache-20af452b-8d73-42f4-8030-b6f488642876" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:50:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:02 user nova-compute[75239]: DEBUG nova.compute.manager [req-c83ccb99-54b9-4e35-989c-a257df16f9ea req-5f74e515-bc0e-4a66-8f00-730d97fdb78b service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received event network-vif-plugged-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c83ccb99-54b9-4e35-989c-a257df16f9ea req-5f74e515-bc0e-4a66-8f00-730d97fdb78b service nova] Acquiring lock "20af452b-8d73-42f4-8030-b6f488642876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c83ccb99-54b9-4e35-989c-a257df16f9ea req-5f74e515-bc0e-4a66-8f00-730d97fdb78b service nova] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c83ccb99-54b9-4e35-989c-a257df16f9ea req-5f74e515-bc0e-4a66-8f00-730d97fdb78b service nova] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:02 user nova-compute[75239]: DEBUG nova.compute.manager [req-c83ccb99-54b9-4e35-989c-a257df16f9ea req-5f74e515-bc0e-4a66-8f00-730d97fdb78b service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] No waiting events found dispatching network-vif-plugged-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:50:02 user nova-compute[75239]: WARNING nova.compute.manager [req-c83ccb99-54b9-4e35-989c-a257df16f9ea req-5f74e515-bc0e-4a66-8f00-730d97fdb78b service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received unexpected event network-vif-plugged-4108eedc-7fc3-4282-a085-894876e35493 for instance with vm_state building and task_state spawning.
Nov 13 20:50:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:50:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Instance spawned successfully.
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:04 user nova-compute[75239]: INFO nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-eca99d21-5f02-47e4-8b91-12fab695c15e req-442c3e83-1015-4738-8c33-56fa88d3103c service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received event network-vif-plugged-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-eca99d21-5f02-47e4-8b91-12fab695c15e req-442c3e83-1015-4738-8c33-56fa88d3103c service nova] Acquiring lock "20af452b-8d73-42f4-8030-b6f488642876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-eca99d21-5f02-47e4-8b91-12fab695c15e req-442c3e83-1015-4738-8c33-56fa88d3103c service nova] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-eca99d21-5f02-47e4-8b91-12fab695c15e req-442c3e83-1015-4738-8c33-56fa88d3103c service nova] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-eca99d21-5f02-47e4-8b91-12fab695c15e req-442c3e83-1015-4738-8c33-56fa88d3103c service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] No waiting events found dispatching network-vif-plugged-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:50:04 user nova-compute[75239]: WARNING nova.compute.manager [req-eca99d21-5f02-47e4-8b91-12fab695c15e req-442c3e83-1015-4738-8c33-56fa88d3103c service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received unexpected event network-vif-plugged-4108eedc-7fc3-4282-a085-894876e35493 for instance with vm_state building and task_state spawning.
Nov 13 20:50:04 user nova-compute[75239]: INFO nova.compute.manager [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Took 6.09 seconds to build instance.
Nov 13 20:50:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d62500d2-7bdd-4161-9972-d087b40f79ec tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "20af452b-8d73-42f4-8030-b6f488642876" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.185s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "ef944343-26de-4b6f-a3de-031e25680346" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:50:26 user nova-compute[75239]: INFO nova.compute.claims [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Claim successful on node user
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:50:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.policy [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b99b7e2d05b45b3855c6d4debeb46a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc2074bf752f49f58f8ccc88a33b6309', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:50:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Creating image(s)
Nov 13 20:50:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "/opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "/opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Successfully created port: eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk 1073741824" returned: 0 in 0.057s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.270s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Cannot resize image /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Ensure instance console log exists: /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Successfully updated port: eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-e0a11fae-276b-47a1-bcb6-adad14f2be9c req-9d0aad5c-c03e-4d79-920c-b7c6e4762270 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-changed-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-e0a11fae-276b-47a1-bcb6-adad14f2be9c req-9d0aad5c-c03e-4d79-920c-b7c6e4762270 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Refreshing instance network info cache due to event network-changed-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e0a11fae-276b-47a1-bcb6-adad14f2be9c req-9d0aad5c-c03e-4d79-920c-b7c6e4762270 service nova] Acquiring lock "refresh_cache-ef944343-26de-4b6f-a3de-031e25680346" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e0a11fae-276b-47a1-bcb6-adad14f2be9c req-9d0aad5c-c03e-4d79-920c-b7c6e4762270 service nova] Acquired lock "refresh_cache-ef944343-26de-4b6f-a3de-031e25680346" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-e0a11fae-276b-47a1-bcb6-adad14f2be9c req-9d0aad5c-c03e-4d79-920c-b7c6e4762270 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Refreshing network info cache for port eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "refresh_cache-ef944343-26de-4b6f-a3de-031e25680346" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-e0a11fae-276b-47a1-bcb6-adad14f2be9c req-9d0aad5c-c03e-4d79-920c-b7c6e4762270 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.neutron [req-e0a11fae-276b-47a1-bcb6-adad14f2be9c req-9d0aad5c-c03e-4d79-920c-b7c6e4762270 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e0a11fae-276b-47a1-bcb6-adad14f2be9c req-9d0aad5c-c03e-4d79-920c-b7c6e4762270 service nova] Releasing lock "refresh_cache-ef944343-26de-4b6f-a3de-031e25680346" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquired lock "refresh_cache-ef944343-26de-4b6f-a3de-031e25680346" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Updating instance_info_cache with network_info: [{"id": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "address": "fa:16:3e:8a:20:ba", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef6c28b-1e", "ovs_interfaceid": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Releasing lock "refresh_cache-ef944343-26de-4b6f-a3de-031e25680346" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Instance network_info: |[{"id": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "address": "fa:16:3e:8a:20:ba", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef6c28b-1e", "ovs_interfaceid": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Start _get_guest_xml network_info=[{"id": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "address": "fa:16:3e:8a:20:ba", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef6c28b-1e", "ovs_interfaceid": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:50:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:50:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1739935053',display_name='tempest-VolumesActionsTest-instance-1739935053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1739935053',id=37,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc2074bf752f49f58f8ccc88a33b6309',ramdisk_id='',reservation_id='r-bighb8cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1662331085',owner_user_name='tempest-VolumesActionsTest-1662331085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:50:27Z,user_data=None,user_id='8b99b7e2d05b45b3855c6d4debeb46a2',uuid=ef944343-26de-4b6f-a3de-031e25680346,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "address": "fa:16:3e:8a:20:ba", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef6c28b-1e", "ovs_interfaceid": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converting VIF {"id": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "address": "fa:16:3e:8a:20:ba", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef6c28b-1e", "ovs_interfaceid": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:20:ba,bridge_name='br-int',has_traffic_filtering=True,id=eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef6c28b-1e') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lazy-loading 'pci_devices' on Instance uuid ef944343-26de-4b6f-a3de-031e25680346 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:50:28 user nova-compute[75239]:   <uuid>ef944343-26de-4b6f-a3de-031e25680346</uuid>
Nov 13 20:50:28 user nova-compute[75239]:   <name>instance-00000025</name>
Nov 13 20:50:28 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:50:28 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:50:28 user nova-compute[75239]:   <metadata>
Nov 13 20:50:28 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:50:28 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:50:28 user nova-compute[75239]:       <nova:name>tempest-VolumesActionsTest-instance-1739935053</nova:name>
Nov 13 20:50:28 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:50:28</nova:creationTime>
Nov 13 20:50:28 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:50:28 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:50:28 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:50:28 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:50:28 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:50:28 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:50:28 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:50:28 user nova-compute[75239]:       <nova:owner>
Nov 13 20:50:28 user nova-compute[75239]:         <nova:user uuid="8b99b7e2d05b45b3855c6d4debeb46a2">tempest-VolumesActionsTest-1662331085-project-member</nova:user>
Nov 13 20:50:28 user nova-compute[75239]:         <nova:project uuid="dc2074bf752f49f58f8ccc88a33b6309">tempest-VolumesActionsTest-1662331085</nova:project>
Nov 13 20:50:28 user nova-compute[75239]:       </nova:owner>
Nov 13 20:50:28 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:50:28 user nova-compute[75239]:       <nova:ports>
Nov 13 20:50:28 user nova-compute[75239]:         <nova:port uuid="eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d">
Nov 13 20:50:28 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 20:50:28 user nova-compute[75239]:         </nova:port>
Nov 13 20:50:28 user nova-compute[75239]:       </nova:ports>
Nov 13 20:50:28 user nova-compute[75239]:     </nova:instance>
Nov 13 20:50:28 user nova-compute[75239]:   </metadata>
Nov 13 20:50:28 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:50:28 user nova-compute[75239]:     <system>
Nov 13 20:50:28 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:50:28 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:50:28 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:50:28 user nova-compute[75239]:       <entry name="serial">ef944343-26de-4b6f-a3de-031e25680346</entry>
Nov 13 20:50:28 user nova-compute[75239]:       <entry name="uuid">ef944343-26de-4b6f-a3de-031e25680346</entry>
Nov 13 20:50:28 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:50:28 user nova-compute[75239]:     </system>
Nov 13 20:50:28 user nova-compute[75239]:   </sysinfo>
Nov 13 20:50:28 user nova-compute[75239]:   <os>
Nov 13 20:50:28 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:50:28 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:50:28 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:50:28 user nova-compute[75239]:   </os>
Nov 13 20:50:28 user nova-compute[75239]:   <features>
Nov 13 20:50:28 user nova-compute[75239]:     <acpi/>
Nov 13 20:50:28 user nova-compute[75239]:     <apic/>
Nov 13 20:50:28 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:50:28 user nova-compute[75239]:   </features>
Nov 13 20:50:28 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:50:28 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:50:28 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:50:28 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:50:28 user nova-compute[75239]:   </clock>
Nov 13 20:50:28 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:50:28 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:50:28 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:50:28 user nova-compute[75239]:   </cpu>
Nov 13 20:50:28 user nova-compute[75239]:   <devices>
Nov 13 20:50:28 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:50:28 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:50:28 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk"/>
Nov 13 20:50:28 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:50:28 user nova-compute[75239]:     </disk>
Nov 13 20:50:28 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:50:28 user nova-compute[75239]:       <mac address="fa:16:3e:8a:20:ba"/>
Nov 13 20:50:28 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:50:28 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:50:28 user nova-compute[75239]:       <target dev="tapeef6c28b-1e"/>
Nov 13 20:50:28 user nova-compute[75239]:     </interface>
Nov 13 20:50:28 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:50:28 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/console.log" append="off"/>
Nov 13 20:50:28 user nova-compute[75239]:     </serial>
Nov 13 20:50:28 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:50:28 user nova-compute[75239]:     <video>
Nov 13 20:50:28 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:50:28 user nova-compute[75239]:     </video>
Nov 13 20:50:28 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:50:28 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:50:28 user nova-compute[75239]:     </rng>
Nov 13 20:50:28 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:50:28 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:50:28 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:50:28 user nova-compute[75239]:     </memballoon>
Nov 13 20:50:28 user nova-compute[75239]:   </devices>
Nov 13 20:50:28 user nova-compute[75239]: </domain>
Nov 13 20:50:28 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1739935053',display_name='tempest-VolumesActionsTest-instance-1739935053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1739935053',id=37,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dc2074bf752f49f58f8ccc88a33b6309',ramdisk_id='',reservation_id='r-bighb8cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1662331085',owner_user_name='tempest-VolumesActionsTest-1662331085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:50:27Z,user_data=None,user_id='8b99b7e2d05b45b3855c6d4debeb46a2',uuid=ef944343-26de-4b6f-a3de-031e25680346,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "address": "fa:16:3e:8a:20:ba", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef6c28b-1e", "ovs_interfaceid": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converting VIF {"id": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "address": "fa:16:3e:8a:20:ba", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef6c28b-1e", "ovs_interfaceid": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:20:ba,bridge_name='br-int',has_traffic_filtering=True,id=eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef6c28b-1e') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG os_vif [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:20:ba,bridge_name='br-int',has_traffic_filtering=True,id=eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef6c28b-1e') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e9699d4-570c-5c1a-9966-fdc7dbf36ce8', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeef6c28b-1e, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeef6c28b-1e, col_values=(('qos', UUID('74a04407-bd9e-44ec-8ffe-61b40f0be8e9')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeef6c28b-1e, col_values=(('external_ids', {'iface-id': 'eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:20:ba', 'vm-uuid': 'ef944343-26de-4b6f-a3de-031e25680346'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:28 user nova-compute[75239]: INFO os_vif [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:20:ba,bridge_name='br-int',has_traffic_filtering=True,id=eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef6c28b-1e')
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:50:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] No VIF found with MAC fa:16:3e:8a:20:ba, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-73619715-3074-418c-a885-f742fc4ba969 req-210f8cf7-0d8b-4ac9-8a10-26a16d378eea service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-73619715-3074-418c-a885-f742fc4ba969 req-210f8cf7-0d8b-4ac9-8a10-26a16d378eea service nova] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-73619715-3074-418c-a885-f742fc4ba969 req-210f8cf7-0d8b-4ac9-8a10-26a16d378eea service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-73619715-3074-418c-a885-f742fc4ba969 req-210f8cf7-0d8b-4ac9-8a10-26a16d378eea service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-73619715-3074-418c-a885-f742fc4ba969 req-210f8cf7-0d8b-4ac9-8a10-26a16d378eea service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] No waiting events found dispatching network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:50:30 user nova-compute[75239]: WARNING nova.compute.manager [req-73619715-3074-418c-a885-f742fc4ba969 req-210f8cf7-0d8b-4ac9-8a10-26a16d378eea service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received unexpected event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d for instance with vm_state building and task_state spawning.
Nov 13 20:50:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:31 user nova-compute[75239]: INFO nova.compute.manager [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Terminating instance
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-6fdaa0f7-21c7-468b-a996-a482980e01dd req-28719db3-2e51-4159-97cf-ba2814cbf0a6 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received event network-vif-unplugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6fdaa0f7-21c7-468b-a996-a482980e01dd req-28719db3-2e51-4159-97cf-ba2814cbf0a6 service nova] Acquiring lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6fdaa0f7-21c7-468b-a996-a482980e01dd req-28719db3-2e51-4159-97cf-ba2814cbf0a6 service nova] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6fdaa0f7-21c7-468b-a996-a482980e01dd req-28719db3-2e51-4159-97cf-ba2814cbf0a6 service nova] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-6fdaa0f7-21c7-468b-a996-a482980e01dd req-28719db3-2e51-4159-97cf-ba2814cbf0a6 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] No waiting events found dispatching network-vif-unplugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-6fdaa0f7-21c7-468b-a996-a482980e01dd req-28719db3-2e51-4159-97cf-ba2814cbf0a6 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received event network-vif-unplugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Instance destroyed successfully.
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'resources' on Instance uuid cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-236347244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-236347244',id=24,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:41:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-3i88zu0y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:43:05Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "address": "fa:16:3e:c6:2c:c0", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be9bad0-81", "ovs_interfaceid": "7be9bad0-818f-4a3c-a268-eee73dca9d13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:c0,bridge_name='br-int',has_traffic_filtering=True,id=7be9bad0-818f-4a3c-a268-eee73dca9d13,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9bad0-81') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG os_vif [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:c0,bridge_name='br-int',has_traffic_filtering=True,id=7be9bad0-818f-4a3c-a268-eee73dca9d13,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9bad0-81') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7be9bad0-81, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f44b2b2-9999-4cdc-b943-47044802fdab) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:31 user nova-compute[75239]: INFO os_vif [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:2c:c0,bridge_name='br-int',has_traffic_filtering=True,id=7be9bad0-818f-4a3c-a268-eee73dca9d13,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be9bad0-81')
Nov 13 20:50:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Deleting instance files /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3_del
Nov 13 20:50:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Deletion of /opt/stack/data/nova/instances/cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3_del complete
Nov 13 20:50:31 user nova-compute[75239]: INFO nova.compute.manager [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 13 20:50:31 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:50:31 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:50:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ef944343-26de-4b6f-a3de-031e25680346] Instance spawned successfully.
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:50:32 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Took 0.41 seconds to deallocate network for instance.
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-c83064c6-34e7-428b-ad77-3c5a5286b6a6 req-b007422c-7180-4967-b929-a5396f153d46 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c83064c6-34e7-428b-ad77-3c5a5286b6a6 req-b007422c-7180-4967-b929-a5396f153d46 service nova] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c83064c6-34e7-428b-ad77-3c5a5286b6a6 req-b007422c-7180-4967-b929-a5396f153d46 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c83064c6-34e7-428b-ad77-3c5a5286b6a6 req-b007422c-7180-4967-b929-a5396f153d46 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-c83064c6-34e7-428b-ad77-3c5a5286b6a6 req-b007422c-7180-4967-b929-a5396f153d46 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] No waiting events found dispatching network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:50:32 user nova-compute[75239]: WARNING nova.compute.manager [req-c83064c6-34e7-428b-ad77-3c5a5286b6a6 req-b007422c-7180-4967-b929-a5396f153d46 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received unexpected event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d for instance with vm_state building and task_state spawning.
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:32 user nova-compute[75239]: INFO nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:50:32 user nova-compute[75239]: INFO nova.compute.manager [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Took 6.26 seconds to build instance.
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9c3c0b77-6ff3-415b-8886-0a8d2c6a88c4 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "ef944343-26de-4b6f-a3de-031e25680346" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.476s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:32 user nova-compute[75239]: INFO nova.compute.manager [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Terminating instance
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:50:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.568s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:32 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Deleted allocations for instance cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6749d8c3-2a83-4a3f-806d-0ecfd94b39fb tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.865s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:33 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Instance destroyed successfully.
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.objects.instance [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'resources' on Instance uuid e62931e3-90bb-4959-825c-e80dfc391989 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:43:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1277596519',display_name='tempest-ServerActionsTestOtherA-server-1277596519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1277596519',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx37q9vY0QYlo3fI5aFH9X6d2hNyPjTGXNNUmCr6ibGa/Kc1ClaPlhMidaIIsV7Y1igpikXwuCDpafpWPc5/9hzW0qq+/XK1xQPQ4kHZy5qMv84+zHN9XJn4hcGarD9Lw==',key_name='tempest-keypair-1127026760',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:46:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-qvsenhs8',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=e62931e3-90bb-4959-825c-e80dfc391989,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "c81078b8-09c9-413f-8166-acd8fa285a00", "address": "fa:16:3e:3f:04:f5", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81078b8-09", "ovs_interfaceid": "c81078b8-09c9-413f-8166-acd8fa285a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_vif [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc81078b8-09, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48bd359b-8935-4747-884a-e23242ab924e) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:50:33 user nova-compute[75239]: INFO os_vif [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:04:f5,bridge_name='br-int',has_traffic_filtering=True,id=c81078b8-09c9-413f-8166-acd8fa285a00,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81078b8-09')
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wORodVyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:50:33 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a26f540-0f97-4a1f-9619-67c443221ba0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:50:33 user nova-compute[75239]: No targets found.
Nov 13 20:50:33 user nova-compute[75239]: iSNS:
Nov 13 20:50:33 user nova-compute[75239]: No targets found.
Nov 13 20:50:33 user nova-compute[75239]: STATIC:
Nov 13 20:50:33 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:50:33 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:50:33 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:50:33 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9
Nov 13 20:50:33 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:50:33 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:50:33 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8
Nov 13 20:50:33 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:50:33 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:50:33 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c
Nov 13 20:50:33 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:50:33 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:50:33 user nova-compute[75239]: FIRMWARE:
Nov 13 20:50:33 user nova-compute[75239]: No targets found.
Nov 13 20:50:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:50:33 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:50:33 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce21aee8-bcf9-4995-9b63-526b4b1e1324]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c5b55f-247f-4830-b7ba-29c17c8e7c82]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:50:33 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:50:33 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:50:33 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:50:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:50:33 user nova-compute[75239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 (non-flash)
Nov 13 20:50:33 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:50:33 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:50:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605aedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9'): ({'sdd'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Removing single pathed devices sdd {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received event network-vif-plugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] Acquiring lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] Lock "cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] No waiting events found dispatching network-vif-plugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:50:33 user nova-compute[75239]: WARNING nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received unexpected event network-vif-plugged-7be9bad0-818f-4a3c-a268-eee73dca9d13 for instance with vm_state deleted and task_state None.
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: cf387cda-b6bf-4ad0-9f01-0b7bfb7dd5b3] Received event network-vif-deleted-7be9bad0-818f-4a3c-a268-eee73dca9d13 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-unplugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] No waiting events found dispatching network-vif-unplugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-unplugged-c81078b8-09c9-413f-8166-acd8fa285a00 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] Acquiring lock "e62931e3-90bb-4959-825c-e80dfc391989-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] Lock "e62931e3-90bb-4959-825c-e80dfc391989-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] No waiting events found dispatching network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:50:33 user nova-compute[75239]: WARNING nova.compute.manager [req-b0585ea4-7318-4404-8dd9-099a0e799f45 req-5ec0d73a-6df7-4efc-921e-164554183d92 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received unexpected event network-vif-plugged-c81078b8-09c9-413f-8166-acd8fa285a00 for instance with vm_state active and task_state deleting.
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16dd8ce-6f59-4a45-9ba2-8fc4de514e31]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c572bfd6-6f14-444a-bcc2-d07cbba39488]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Flushing IO for device /dev/sdd {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd168b26-4186-4ca1-9fc3-18f72d1fdabd]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d8b5ce-c341-455f-97c5-f413d18d5b5b]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26533633130373631', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1bb63187', '/dev/disk/by-id/scsi-1SCST_BIO1bb63187-e3c107610386b02f') {{(pid=86402) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[58784a60-8668-4b1b-bff7-459ff911a287]: (4, None) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7b380b-6728-4bef-81a7-1f6567454e6c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0299c5c8-77ab-42dc-b883-dd4ebd983d0f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260]
Nov 13 20:50:33 user nova-compute[75239]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9, portal: 172.16.0.220,3260] successful.
Nov 13 20:50:33 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c8c478-4062-4a30-bd74-4e6967c43160]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] <== disconnect_volume: return (337ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:50:33 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Deleting instance files /opt/stack/data/nova/instances/e62931e3-90bb-4959-825c-e80dfc391989_del
Nov 13 20:50:33 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Deletion of /opt/stack/data/nova/instances/e62931e3-90bb-4959-825c-e80dfc391989_del complete
Nov 13 20:50:33 user nova-compute[75239]: INFO nova.compute.manager [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 13 20:50:33 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:50:33 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: e62931e3-90bb-4959-825c-e80dfc391989] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:50:34 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:34 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Took 0.79 seconds to deallocate network for instance.
Nov 13 20:50:35 user nova-compute[75239]: INFO nova.compute.manager [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Took 0.86 seconds to detach 1 volumes for instance.
Nov 13 20:50:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Deleting volume: 3a60d3dd-39ef-42d4-9c16-d13ccdea60c9 {{(pid=75239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 20:50:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-d4d0c4cc-333f-4f5b-a54a-db66479c4810 req-3cd60320-67cb-43fd-aeb1-e56d9e29c0c8 service nova] [instance: e62931e3-90bb-4959-825c-e80dfc391989] Received event network-vif-deleted-c81078b8-09c9-413f-8166-acd8fa285a00 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:35 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:50:36 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:50:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:36 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Deleted allocations for instance e62931e3-90bb-4959-825c-e80dfc391989
Nov 13 20:50:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-865b2c74-7a75-4265-a4d2-6222b8a911d4 tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "e62931e3-90bb-4959-825c-e80dfc391989" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.499s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:50:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:50:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:50:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7720MB free_disk=24.72512435913086GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 1796f4bf-40b0-4a4a-85a5-3690fb761031 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a9ed319e-d732-4930-89b4-7a61ea6cf930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 20af452b-8d73-42f4-8030-b6f488642876 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ef944343-26de-4b6f-a3de-031e25680346 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:50:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:50:42 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:50:42 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:50:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:50:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.423s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:50:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:50:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:50:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:50:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:50:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:50:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:50:46 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updating instance_info_cache with network_info: [{"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-3cbf6e73-bc09-4e1f-b249-261f0534c6e0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:50:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:50:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:54 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:50:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-0615c2cb-812c-42f9-bf9e-8637c561f2df req-331cdab9-43e3-439b-b7e2-43f416ac2d02 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-changed-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-0615c2cb-812c-42f9-bf9e-8637c561f2df req-331cdab9-43e3-439b-b7e2-43f416ac2d02 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Refreshing instance network info cache due to event network-changed-6675cf99-b5e8-402b-a98e-d4190071da32. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:50:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0615c2cb-812c-42f9-bf9e-8637c561f2df req-331cdab9-43e3-439b-b7e2-43f416ac2d02 service nova] Acquiring lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:50:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0615c2cb-812c-42f9-bf9e-8637c561f2df req-331cdab9-43e3-439b-b7e2-43f416ac2d02 service nova] Acquired lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:50:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-0615c2cb-812c-42f9-bf9e-8637c561f2df req-331cdab9-43e3-439b-b7e2-43f416ac2d02 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Refreshing network info cache for port 6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:50:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:55 user nova-compute[75239]: INFO nova.compute.manager [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Detaching volume 74ef42f0-afde-4a16-a2d9-5e4e72b62c4c
Nov 13 20:50:55 user nova-compute[75239]: DEBUG nova.network.neutron [req-0615c2cb-812c-42f9-bf9e-8637c561f2df req-331cdab9-43e3-439b-b7e2-43f416ac2d02 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updated VIF entry in instance network info cache for port 6675cf99-b5e8-402b-a98e-d4190071da32. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:50:55 user nova-compute[75239]: DEBUG nova.network.neutron [req-0615c2cb-812c-42f9-bf9e-8637c561f2df req-331cdab9-43e3-439b-b7e2-43f416ac2d02 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:55 user nova-compute[75239]: INFO nova.virt.block_device [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Attempting to driver detach volume 74ef42f0-afde-4a16-a2d9-5e4e72b62c4c from mountpoint /dev/vdb
Nov 13 20:50:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0615c2cb-812c-42f9-bf9e-8637c561f2df req-331cdab9-43e3-439b-b7e2-43f416ac2d02 service nova] Releasing lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:50:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Attempting to detach device vdb from instance a9ed319e-d732-4930-89b4-7a61ea6cf930 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:50:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:50:55 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:50:55 user nova-compute[75239]:   <source dev="/dev/sde"/>
Nov 13 20:50:55 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:50:55 user nova-compute[75239]:   <serial>74ef42f0-afde-4a16-a2d9-5e4e72b62c4c</serial>
Nov 13 20:50:55 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:50:55 user nova-compute[75239]: </disk>
Nov 13 20:50:55 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:50:55 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Successfully detached device vdb from instance a9ed319e-d732-4930-89b4-7a61ea6cf930 from the persistent domain config.
Nov 13 20:50:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9ed319e-d732-4930-89b4-7a61ea6cf930 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:50:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:50:55 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:50:55 user nova-compute[75239]:   <source dev="/dev/sde"/>
Nov 13 20:50:55 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:50:55 user nova-compute[75239]:   <serial>74ef42f0-afde-4a16-a2d9-5e4e72b62c4c</serial>
Nov 13 20:50:55 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:50:55 user nova-compute[75239]: </disk>
Nov 13 20:50:55 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:50:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:50:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-d891bc74-d0e4-4ef5-9ed1-f249ca6b30cf req-439048e4-815d-45b3-8317-29f7bb2533d7 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-changed-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:56 user nova-compute[75239]: DEBUG nova.compute.manager [req-d891bc74-d0e4-4ef5-9ed1-f249ca6b30cf req-439048e4-815d-45b3-8317-29f7bb2533d7 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Refreshing instance network info cache due to event network-changed-6675cf99-b5e8-402b-a98e-d4190071da32. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:50:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d891bc74-d0e4-4ef5-9ed1-f249ca6b30cf req-439048e4-815d-45b3-8317-29f7bb2533d7 service nova] Acquiring lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:50:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d891bc74-d0e4-4ef5-9ed1-f249ca6b30cf req-439048e4-815d-45b3-8317-29f7bb2533d7 service nova] Acquired lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:50:56 user nova-compute[75239]: DEBUG nova.network.neutron [req-d891bc74-d0e4-4ef5-9ed1-f249ca6b30cf req-439048e4-815d-45b3-8317-29f7bb2533d7 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Refreshing network info cache for port 6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-d891bc74-d0e4-4ef5-9ed1-f249ca6b30cf req-439048e4-815d-45b3-8317-29f7bb2533d7 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updated VIF entry in instance network info cache for port 6675cf99-b5e8-402b-a98e-d4190071da32. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-d891bc74-d0e4-4ef5-9ed1-f249ca6b30cf req-439048e4-815d-45b3-8317-29f7bb2533d7 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [{"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d891bc74-d0e4-4ef5-9ed1-f249ca6b30cf req-439048e4-815d-45b3-8317-29f7bb2533d7 service nova] Releasing lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-4c9b8d7b-8caa-446c-8a89-e518f6d81d50 req-e8d60a6d-7b4a-4390-8286-7ef9335c0ef4 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-4c9b8d7b-8caa-446c-8a89-e518f6d81d50 req-e8d60a6d-7b4a-4390-8286-7ef9335c0ef4 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing instance network info cache due to event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4c9b8d7b-8caa-446c-8a89-e518f6d81d50 req-e8d60a6d-7b4a-4390-8286-7ef9335c0ef4 service nova] Acquiring lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4c9b8d7b-8caa-446c-8a89-e518f6d81d50 req-e8d60a6d-7b4a-4390-8286-7ef9335c0ef4 service nova] Acquired lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-4c9b8d7b-8caa-446c-8a89-e518f6d81d50 req-e8d60a6d-7b4a-4390-8286-7ef9335c0ef4 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-4c9b8d7b-8caa-446c-8a89-e518f6d81d50 req-e8d60a6d-7b4a-4390-8286-7ef9335c0ef4 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updated VIF entry in instance network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG nova.network.neutron [req-4c9b8d7b-8caa-446c-8a89-e518f6d81d50 req-e8d60a6d-7b4a-4390-8286-7ef9335c0ef4 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updating instance_info_cache with network_info: [{"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4c9b8d7b-8caa-446c-8a89-e518f6d81d50 req-e8d60a6d-7b4a-4390-8286-7ef9335c0ef4 service nova] Releasing lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-24c1cd96-6fd6-44e3-98c9-1328200806cc req-92cda6a8-f25a-4dc8-a273-add2a9596226 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-24c1cd96-6fd6-44e3-98c9-1328200806cc req-92cda6a8-f25a-4dc8-a273-add2a9596226 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing instance network info cache due to event network-changed-50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-24c1cd96-6fd6-44e3-98c9-1328200806cc req-92cda6a8-f25a-4dc8-a273-add2a9596226 service nova] Acquiring lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-24c1cd96-6fd6-44e3-98c9-1328200806cc req-92cda6a8-f25a-4dc8-a273-add2a9596226 service nova] Acquired lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.network.neutron [req-24c1cd96-6fd6-44e3-98c9-1328200806cc req-92cda6a8-f25a-4dc8-a273-add2a9596226 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Refreshing network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:50:58 user nova-compute[75239]: INFO nova.compute.manager [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Detaching volume 67298ef5-dae6-42a3-b16d-883720ab51e8
Nov 13 20:50:58 user nova-compute[75239]: INFO nova.virt.block_device [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Attempting to driver detach volume 67298ef5-dae6-42a3-b16d-883720ab51e8 from mountpoint /dev/vdb
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Attempting to detach device vdb from instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:50:58 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:50:58 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:50:58 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:50:58 user nova-compute[75239]:   <serial>67298ef5-dae6-42a3-b16d-883720ab51e8</serial>
Nov 13 20:50:58 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:50:58 user nova-compute[75239]: </disk>
Nov 13 20:50:58 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:50:58 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully detached device vdb from instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 from the persistent domain config.
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:50:58 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:50:58 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:50:58 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:50:58 user nova-compute[75239]:   <serial>67298ef5-dae6-42a3-b16d-883720ab51e8</serial>
Nov 13 20:50:58 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:50:58 user nova-compute[75239]: </disk>
Nov 13 20:50:58 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.network.neutron [req-24c1cd96-6fd6-44e3-98c9-1328200806cc req-92cda6a8-f25a-4dc8-a273-add2a9596226 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updated VIF entry in instance network info cache for port 50b5756c-5cce-4cb1-94f0-6283cdc80052. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.network.neutron [req-24c1cd96-6fd6-44e3-98c9-1328200806cc req-92cda6a8-f25a-4dc8-a273-add2a9596226 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updating instance_info_cache with network_info: [{"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-24c1cd96-6fd6-44e3-98c9-1328200806cc req-92cda6a8-f25a-4dc8-a273-add2a9596226 service nova] Releasing lock "refresh_cache-be0bf428-fadf-4e08-87ac-9563fb31d1b8" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:50:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:51:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:15 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9ed319e-d732-4930-89b4-7a61ea6cf930 is timed out.
Nov 13 20:51:15 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Successfully detached device vdb from instance a9ed319e-d732-4930-89b4-7a61ea6cf930 from the live domain config.
Nov 13 20:51:15 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zATExGtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:51:15 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[353d28f2-a17d-45e1-bd4e-fb042a80a1b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:51:15 user nova-compute[75239]: No targets found.
Nov 13 20:51:15 user nova-compute[75239]: iSNS:
Nov 13 20:51:15 user nova-compute[75239]: No targets found.
Nov 13 20:51:15 user nova-compute[75239]: STATIC:
Nov 13 20:51:15 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:51:15 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:51:15 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:51:15 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8
Nov 13 20:51:15 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:51:15 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:51:15 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c
Nov 13 20:51:15 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:51:15 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:51:15 user nova-compute[75239]: FIRMWARE:
Nov 13 20:51:15 user nova-compute[75239]: No targets found.
Nov 13 20:51:15 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:51:15 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:51:15 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ee08b5-53f1-45b4-a9ee-09dfd197ad7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ac67db-133c-4c68-b2e4-a3e2f51c601d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:51:15 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:51:15 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:51:15 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:51:15 user nova-compute[75239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c (non-flash)
Nov 13 20:51:15 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:51:15 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605d24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c'): ({'sde'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Removing single pathed devices sde {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31f2186-b45a-43aa-a62a-735a72781019]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb60fe2-0153-4894-8f13-5a236a3d701e]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Flushing IO for device /dev/sde {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e95c251-7b13-4ea5-9ece-130af5cefab1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbb6724-5778-4765-8776-1f10bed020a9]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] SCSI volumes sde have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:51:15 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e01f53-7c63-451b-9f4e-65ecc44d66ff]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[786a0289-51ad-48de-a7c5-eafb87fbacf9]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c, portal: 172.16.0.220,3260]
Nov 13 20:51:16 user nova-compute[75239]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c, portal: 172.16.0.220,3260] successful.
Nov 13 20:51:16 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74ef42f0-afde-4a16-a2d9-5e4e72b62c4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefbbeb2-ead9-46da-b546-57af909c5b8d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] <== disconnect_volume: return (305ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG nova.objects.instance [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'flavor' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-98744023-94b7-4314-bc45-0278217b9577 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.663s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:51:18 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 is timed out.
Nov 13 20:51:18 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully detached device vdb from instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 from the live domain config.
Nov 13 20:51:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:51:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MpaLemSq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:51:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:51:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:51:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:51:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e02aa5-1626-4a1f-b555-3189a5528d8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:51:19 user nova-compute[75239]: No targets found.
Nov 13 20:51:19 user nova-compute[75239]: iSNS:
Nov 13 20:51:19 user nova-compute[75239]: No targets found.
Nov 13 20:51:19 user nova-compute[75239]: STATIC:
Nov 13 20:51:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:51:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:51:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:51:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8
Nov 13 20:51:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:51:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:51:19 user nova-compute[75239]: FIRMWARE:
Nov 13 20:51:19 user nova-compute[75239]: No targets found.
Nov 13 20:51:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:51:19 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:51:19 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f395ba4-e688-4531-8674-719ce0e8e217]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[782d9369-1ab7-4ecb-a1bc-d54cc46363ef]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:51:19 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:51:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:51:19 user nova-compute[75239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 (non-flash)
Nov 13 20:51:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60599900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6b3529-e149-4e0e-a358-b5a61f3e8384]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b54b2a-483e-4d7d-999f-b481c3376dcc]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8404992f-12de-4217-bcb9-c0aed99456d8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17b6d59-ac8d-4547-9999-1615ccb8affa]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d84ef10-6f6f-48ca-ae2f-c0c9da59e030]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acc4535-9491-4afa-88fa-e47a4d02d5df]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8, portal: 172.16.0.220,3260]
Nov 13 20:51:19 user nova-compute[75239]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8, portal: 172.16.0.220,3260] successful.
Nov 13 20:51:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67298ef5-dae6-42a3-b16d-883720ab51e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4450321a-01e7-4854-b7fc-a109332aca1c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] <== disconnect_volume: return (293ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:51:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:51:20 user nova-compute[75239]: DEBUG nova.objects.instance [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'flavor' on Instance uuid be0bf428-fadf-4e08-87ac-9563fb31d1b8 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0f7a01c7-2947-40da-af1d-6749fa9789ad tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:21 user nova-compute[75239]: INFO nova.compute.manager [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Terminating instance
Nov 13 20:51:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:51:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-2364df0a-5757-44be-971d-cdf9833cf360 req-2d093bff-770d-48b4-ba33-c61761c6f406 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-unplugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2364df0a-5757-44be-971d-cdf9833cf360 req-2d093bff-770d-48b4-ba33-c61761c6f406 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2364df0a-5757-44be-971d-cdf9833cf360 req-2d093bff-770d-48b4-ba33-c61761c6f406 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2364df0a-5757-44be-971d-cdf9833cf360 req-2d093bff-770d-48b4-ba33-c61761c6f406 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-2364df0a-5757-44be-971d-cdf9833cf360 req-2d093bff-770d-48b4-ba33-c61761c6f406 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-unplugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-2364df0a-5757-44be-971d-cdf9833cf360 req-2d093bff-770d-48b4-ba33-c61761c6f406 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-unplugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:51:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Instance destroyed successfully.
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'resources' on Instance uuid 1796f4bf-40b0-4a4a-85a5-3690fb761031 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-340052940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-340052940',id=12,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:37:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-4wazebw1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:39:22Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=1796f4bf-40b0-4a4a-85a5-3690fb761031,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "address": "fa:16:3e:ae:cf:cd", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc95a6584-e3", "ovs_interfaceid": "c95a6584-e3cd-4beb-8917-2bb935d8b507", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=c95a6584-e3cd-4beb-8917-2bb935d8b507,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc95a6584-e3') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_vif [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=c95a6584-e3cd-4beb-8917-2bb935d8b507,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc95a6584-e3') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc95a6584-e3, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=327c4874-409d-49d3-aab0-a0c435dccea2) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:51:22 user nova-compute[75239]: INFO os_vif [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:cf:cd,bridge_name='br-int',has_traffic_filtering=True,id=c95a6584-e3cd-4beb-8917-2bb935d8b507,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc95a6584-e3')
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbyMxieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:51:22 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e65c67-0c64-4c2f-8411-f0e04ff8d09e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:51:22 user nova-compute[75239]: No targets found.
Nov 13 20:51:22 user nova-compute[75239]: iSNS:
Nov 13 20:51:22 user nova-compute[75239]: No targets found.
Nov 13 20:51:22 user nova-compute[75239]: STATIC:
Nov 13 20:51:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad
Nov 13 20:51:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:51:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:51:22 user nova-compute[75239]: FIRMWARE:
Nov 13 20:51:22 user nova-compute[75239]: No targets found.
Nov 13 20:51:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:51:22 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:51:22 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e02cfe-8e8a-4575-b976-dccb4e1f59ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e6a41-f135-4f0c-a26e-b8482afb55a7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:51:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad (non-flash)
Nov 13 20:51:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d604ecaf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14624e4-4d12-406b-8998-47cfe2cc4fff]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6ae51-26f9-4300-b260-663694f14550]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa26aa8-ac46-4b35-a53b-de10728b0659]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[233fdaa9-8737-4aec-8b57-5856315386aa]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[beddc0a1-e184-4ed6-a89f-6f0bdee91cea]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7580911-43b6-42c5-aa0b-9186f8cf4fd6]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad, portal: 172.16.0.220,3260]
Nov 13 20:51:22 user nova-compute[75239]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad, portal: 172.16.0.220,3260] successful.
Nov 13 20:51:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e524d23-a0bd-40df-bd81-6e30dcb200ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[00299d7f-6f05-4180-9faa-9bef814f8306]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] <== disconnect_volume: return (300ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:51:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Deleting instance files /opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031_del
Nov 13 20:51:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Deletion of /opt/stack/data/nova/instances/1796f4bf-40b0-4a4a-85a5-3690fb761031_del complete
Nov 13 20:51:22 user nova-compute[75239]: INFO nova.compute.manager [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 13 20:51:22 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:51:22 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:51:23 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:23 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Took 0.71 seconds to deallocate network for instance.
Nov 13 20:51:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-dd842cab-460e-4147-81ef-24814265e5c3 req-feed644d-85eb-43d3-b01e-8d2d57f59cf7 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dd842cab-460e-4147-81ef-24814265e5c3 req-feed644d-85eb-43d3-b01e-8d2d57f59cf7 service nova] Acquiring lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dd842cab-460e-4147-81ef-24814265e5c3 req-feed644d-85eb-43d3-b01e-8d2d57f59cf7 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-dd842cab-460e-4147-81ef-24814265e5c3 req-feed644d-85eb-43d3-b01e-8d2d57f59cf7 service nova] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-dd842cab-460e-4147-81ef-24814265e5c3 req-feed644d-85eb-43d3-b01e-8d2d57f59cf7 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] No waiting events found dispatching network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:24 user nova-compute[75239]: WARNING nova.compute.manager [req-dd842cab-460e-4147-81ef-24814265e5c3 req-feed644d-85eb-43d3-b01e-8d2d57f59cf7 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received unexpected event network-vif-plugged-c95a6584-e3cd-4beb-8917-2bb935d8b507 for instance with vm_state active and task_state deleting.
Nov 13 20:51:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-dd842cab-460e-4147-81ef-24814265e5c3 req-feed644d-85eb-43d3-b01e-8d2d57f59cf7 service nova] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Received event network-vif-deleted-c95a6584-e3cd-4beb-8917-2bb935d8b507 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:24 user nova-compute[75239]: INFO nova.compute.manager [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: 1796f4bf-40b0-4a4a-85a5-3690fb761031] Took 0.69 seconds to detach 1 volumes for instance.
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:24 user nova-compute[75239]: INFO nova.compute.manager [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Terminating instance
Nov 13 20:51:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:24 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Deleted allocations for instance 1796f4bf-40b0-4a4a-85a5-3690fb761031
Nov 13 20:51:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-03d1d993-126e-48aa-988c-ba259e5c5844 req-63e116d3-d53f-42fe-9402-ca129d34de0e service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received event network-vif-unplugged-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-03d1d993-126e-48aa-988c-ba259e5c5844 req-63e116d3-d53f-42fe-9402-ca129d34de0e service nova] Acquiring lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-03d1d993-126e-48aa-988c-ba259e5c5844 req-63e116d3-d53f-42fe-9402-ca129d34de0e service nova] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-03d1d993-126e-48aa-988c-ba259e5c5844 req-63e116d3-d53f-42fe-9402-ca129d34de0e service nova] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-03d1d993-126e-48aa-988c-ba259e5c5844 req-63e116d3-d53f-42fe-9402-ca129d34de0e service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] No waiting events found dispatching network-vif-unplugged-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-03d1d993-126e-48aa-988c-ba259e5c5844 req-63e116d3-d53f-42fe-9402-ca129d34de0e service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received event network-vif-unplugged-0da27379-6537-4987-ad38-12e5e1d9f277 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:51:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8fc4f396-080e-4bf7-8096-6fbd67ad1c20 tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "1796f4bf-40b0-4a4a-85a5-3690fb761031" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.106s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:25 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Instance destroyed successfully.
Nov 13 20:51:25 user nova-compute[75239]: DEBUG nova.objects.instance [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lazy-loading 'resources' on Instance uuid 36c1f1d7-f3f9-4d41-b116-babf44d80f34 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-572482723',display_name='tempest-ServerActionsTestOtherA-server-572482723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-572482723',id=3,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCx37q9vY0QYlo3fI5aFH9X6d2hNyPjTGXNNUmCr6ibGa/Kc1ClaPlhMidaIIsV7Y1igpikXwuCDpafpWPc5/9hzW0qq+/XK1xQPQ4kHZy5qMv84+zHN9XJn4hcGarD9Lw==',key_name='tempest-keypair-1127026760',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e14ce616b1ad4ee7934e34bad1fdf6a3',ramdisk_id='',reservation_id='r-uccb7jxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1210141142',owner_user_name='tempest-ServerActionsTestOtherA-1210141142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:32:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d8ae2d158f94548bc3d9873317935cd',uuid=36c1f1d7-f3f9-4d41-b116-babf44d80f34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converting VIF {"id": "0da27379-6537-4987-ad38-12e5e1d9f277", "address": "fa:16:3e:fc:9d:7a", "network": {"id": "89ba0ea0-8bb4-4f59-8dcd-9541b7e84184", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1390101111-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e14ce616b1ad4ee7934e34bad1fdf6a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0da27379-65", "ovs_interfaceid": "0da27379-6537-4987-ad38-12e5e1d9f277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:9d:7a,bridge_name='br-int',has_traffic_filtering=True,id=0da27379-6537-4987-ad38-12e5e1d9f277,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da27379-65') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG os_vif [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:9d:7a,bridge_name='br-int',has_traffic_filtering=True,id=0da27379-6537-4987-ad38-12e5e1d9f277,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da27379-65') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0da27379-65, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=994ba2b5-b773-4063-8757-f0049368e874) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:51:25 user nova-compute[75239]: INFO os_vif [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:9d:7a,bridge_name='br-int',has_traffic_filtering=True,id=0da27379-6537-4987-ad38-12e5e1d9f277,network=Network(89ba0ea0-8bb4-4f59-8dcd-9541b7e84184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0da27379-65')
Nov 13 20:51:25 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Deleting instance files /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34_del
Nov 13 20:51:25 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Deletion of /opt/stack/data/nova/instances/36c1f1d7-f3f9-4d41-b116-babf44d80f34_del complete
Nov 13 20:51:25 user nova-compute[75239]: INFO nova.compute.manager [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 20:51:25 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:25 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Took 0.54 seconds to deallocate network for instance.
Nov 13 20:51:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-b6fd65e9-9426-437e-aec7-2c6f56d2b3bd req-faf630e6-4607-491e-b3f8-0f16eb0a5067 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received event network-vif-deleted-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:26 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:51:26 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:51:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:26 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Deleted allocations for instance 36c1f1d7-f3f9-4d41-b116-babf44d80f34
Nov 13 20:51:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e6e817a-89e2-4821-9cb7-e26884b051be tempest-ServerActionsTestOtherA-1210141142 tempest-ServerActionsTestOtherA-1210141142-project-member] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.921s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-d44ce497-13b5-4b99-a94d-13974cf0f02f req-e3b9f9e3-6510-4372-8e50-cb567b69d2c7 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received event network-vif-plugged-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d44ce497-13b5-4b99-a94d-13974cf0f02f req-e3b9f9e3-6510-4372-8e50-cb567b69d2c7 service nova] Acquiring lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d44ce497-13b5-4b99-a94d-13974cf0f02f req-e3b9f9e3-6510-4372-8e50-cb567b69d2c7 service nova] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:26 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d44ce497-13b5-4b99-a94d-13974cf0f02f req-e3b9f9e3-6510-4372-8e50-cb567b69d2c7 service nova] Lock "36c1f1d7-f3f9-4d41-b116-babf44d80f34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:26 user nova-compute[75239]: DEBUG nova.compute.manager [req-d44ce497-13b5-4b99-a94d-13974cf0f02f req-e3b9f9e3-6510-4372-8e50-cb567b69d2c7 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] No waiting events found dispatching network-vif-plugged-0da27379-6537-4987-ad38-12e5e1d9f277 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:26 user nova-compute[75239]: WARNING nova.compute.manager [req-d44ce497-13b5-4b99-a94d-13974cf0f02f req-e3b9f9e3-6510-4372-8e50-cb567b69d2c7 service nova] [instance: 36c1f1d7-f3f9-4d41-b116-babf44d80f34] Received unexpected event network-vif-plugged-0da27379-6537-4987-ad38-12e5e1d9f277 for instance with vm_state deleted and task_state None.
Nov 13 20:51:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-8c09410c-48f1-4076-8ff2-0492807400ed req-8c5fbd83-61f1-409c-a74e-a70269c59917 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received event network-changed-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-8c09410c-48f1-4076-8ff2-0492807400ed req-8c5fbd83-61f1-409c-a74e-a70269c59917 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Refreshing instance network info cache due to event network-changed-cadda64b-9f2a-4646-ab61-aa289f7809b3. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:51:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8c09410c-48f1-4076-8ff2-0492807400ed req-8c5fbd83-61f1-409c-a74e-a70269c59917 service nova] Acquiring lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:51:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8c09410c-48f1-4076-8ff2-0492807400ed req-8c5fbd83-61f1-409c-a74e-a70269c59917 service nova] Acquired lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:51:31 user nova-compute[75239]: DEBUG nova.network.neutron [req-8c09410c-48f1-4076-8ff2-0492807400ed req-8c5fbd83-61f1-409c-a74e-a70269c59917 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Refreshing network info cache for port cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:51:31 user nova-compute[75239]: DEBUG nova.network.neutron [req-8c09410c-48f1-4076-8ff2-0492807400ed req-8c5fbd83-61f1-409c-a74e-a70269c59917 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Updated VIF entry in instance network info cache for port cadda64b-9f2a-4646-ab61-aa289f7809b3. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:51:31 user nova-compute[75239]: DEBUG nova.network.neutron [req-8c09410c-48f1-4076-8ff2-0492807400ed req-8c5fbd83-61f1-409c-a74e-a70269c59917 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Updating instance_info_cache with network_info: [{"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8c09410c-48f1-4076-8ff2-0492807400ed req-8c5fbd83-61f1-409c-a74e-a70269c59917 service nova] Releasing lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:51:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:32 user nova-compute[75239]: DEBUG nova.objects.instance [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'flavor' on Instance uuid 4db9d6bf-a3f0-4495-af7c-272e74e34324 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:33 user nova-compute[75239]: INFO nova.compute.manager [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Attaching volume 54ea501d-5f7a-4df5-a196-a4de8b51abe7 to /dev/vdb
Nov 13 20:51:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG os_brick.utils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b276bfc-c34e-49a9-bbe2-6835d0334af5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc0f641-a11a-4125-920f-60dbda9e26b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e3462f-9847-4ae4-af55-4512de31d5bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e7c50a-5df2-4839-b8ab-cb1b245c5dba]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:51:33 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:51:33 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2187a6a7-cb4d-44a9-92d4-99388f7524ea]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG os_brick.utils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:51:33 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Updating existing volume attachment record: 81e3cc3d-6db7-4514-a56c-0c79f84c0923 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:51:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdnAMvaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:51:37 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:51:37 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:51:37 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cdfbc7-63c6-4704-909d-2a7b6e7d5133]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:51:37 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec075b7-b242-4d84-9352-fd424a082c86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7] added
Nov 13 20:51:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba458c2a-7c70-411e-9a10-3885a3d5b67c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c5e9db-1fab-44cd-8bea-9313f56e17bb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdnAMvaJ {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YdnAMvaJ" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[864758cf-249a-4a7f-b9fc-0f0be156d5ef]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YdnAMvaJ'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa9d406-c0f9-415f-b79a-ed6fc2a84883]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2580c3c2-183c-44dd-8bcf-420728571d74]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:51:37 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:51:37 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:51:37 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 20:51:37 user nova-compute[75239]: 
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd043dad-0b90-429f-964d-578346b1d092]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7, portal: 172.16.0.220,3260]
Nov 13 20:51:37 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7, portal: 172.16.0.220,3260] successful.
Nov 13 20:51:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c3b71e-ad5b-475e-8e56-107721cc31f0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ce7d78-48d2-4471-b69a-8d6250135ca6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 (non-flash)
Nov 13 20:51:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 (non-flash)
Nov 13 20:51:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e98c540-e3fc-432c-806d-c42333b442a6]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdnAMvaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23937336433616362', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937336433616362', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG nova.objects.instance [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'flavor' on Instance uuid 4db9d6bf-a3f0-4495-af7c-272e74e34324 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:51:38 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:51:38 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:51:38 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:51:38 user nova-compute[75239]:   <serial>54ea501d-5f7a-4df5-a196-a4de8b51abe7</serial>
Nov 13 20:51:38 user nova-compute[75239]: </disk>
Nov 13 20:51:38 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No VIF found with MAC fa:16:3e:92:30:7d, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3af19416-ccb4-4160-9d60-5393d32e2492 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.085s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:51:41 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=7877MB free_disk=24.72342300415039GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d816fbc5-c148-472b-9ade-c0175ccb38e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a9ed319e-d732-4930-89b4-7a61ea6cf930 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance be0bf428-fadf-4e08-87ac-9563fb31d1b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 20af452b-8d73-42f4-8030-b6f488642876 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ef944343-26de-4b6f-a3de-031e25680346 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:51:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "d05a4121-e321-432a-9f25-605ad901efdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:51:42 user nova-compute[75239]: INFO nova.compute.claims [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Claim successful on node user
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:51:42 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.policy [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa7ce2c9a26e403d9d802d354b43e8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f422c15f5d0d4a62ad37feabca7faa03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:51:42 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Creating image(s)
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "/opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "/opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "/opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.205s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk 1073741824" returned: 0 in 0.047s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Successfully created port: 26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Cannot resize image /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Ensure instance console log exists: /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:43 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Successfully updated port: 26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "refresh_cache-d05a4121-e321-432a-9f25-605ad901efdd" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquired lock "refresh_cache-d05a4121-e321-432a-9f25-605ad901efdd" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-4ab6eaf1-0c76-41b8-9cb2-665e82e787dc req-9f6cb8e3-3bd5-41d4-bf98-f621f487b84c service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-changed-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-4ab6eaf1-0c76-41b8-9cb2-665e82e787dc req-9f6cb8e3-3bd5-41d4-bf98-f621f487b84c service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Refreshing instance network info cache due to event network-changed-26dcf975-7fd9-4712-8c74-625273620527. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4ab6eaf1-0c76-41b8-9cb2-665e82e787dc req-9f6cb8e3-3bd5-41d4-bf98-f621f487b84c service nova] Acquiring lock "refresh_cache-d05a4121-e321-432a-9f25-605ad901efdd" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Updating instance_info_cache with network_info: [{"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Releasing lock "refresh_cache-d05a4121-e321-432a-9f25-605ad901efdd" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Instance network_info: |[{"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4ab6eaf1-0c76-41b8-9cb2-665e82e787dc req-9f6cb8e3-3bd5-41d4-bf98-f621f487b84c service nova] Acquired lock "refresh_cache-d05a4121-e321-432a-9f25-605ad901efdd" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-4ab6eaf1-0c76-41b8-9cb2-665e82e787dc req-9f6cb8e3-3bd5-41d4-bf98-f621f487b84c service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Refreshing network info cache for port 26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Start _get_guest_xml network_info=[{"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:51:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:51:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:51:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1715884895',display_name='tempest-AttachVolumeNegativeTest-server-1715884895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1715884895',id=38,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW+TS9Id+FRGZR+s1PgLasaKlS1yZqd/+YwqsE9WJ8s9av/6rP87zwQSXwxe85SjPjb75w+e937v/6dmFqcN93kLROZ+sx0zDGtyVL+58SsiKfy84ZhegISL4svdYkpeg==',key_name='tempest-keypair-634537538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-0iw7h0uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=d05a4121-e321-432a-9f25-605ad901efdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4b:37,bridge_name='br-int',has_traffic_filtering=True,id=26dcf975-7fd9-4712-8c74-625273620527,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dcf975-7f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'pci_devices' on Instance uuid d05a4121-e321-432a-9f25-605ad901efdd {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:51:44 user nova-compute[75239]:   <uuid>d05a4121-e321-432a-9f25-605ad901efdd</uuid>
Nov 13 20:51:44 user nova-compute[75239]:   <name>instance-00000026</name>
Nov 13 20:51:44 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:51:44 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:51:44 user nova-compute[75239]:   <metadata>
Nov 13 20:51:44 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:51:44 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:51:44 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1715884895</nova:name>
Nov 13 20:51:44 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:51:44</nova:creationTime>
Nov 13 20:51:44 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:51:44 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:51:44 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:51:44 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:51:44 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:51:44 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:51:44 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:51:44 user nova-compute[75239]:       <nova:owner>
Nov 13 20:51:44 user nova-compute[75239]:         <nova:user uuid="fa7ce2c9a26e403d9d802d354b43e8e7">tempest-AttachVolumeNegativeTest-1236383897-project-member</nova:user>
Nov 13 20:51:44 user nova-compute[75239]:         <nova:project uuid="f422c15f5d0d4a62ad37feabca7faa03">tempest-AttachVolumeNegativeTest-1236383897</nova:project>
Nov 13 20:51:44 user nova-compute[75239]:       </nova:owner>
Nov 13 20:51:44 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:51:44 user nova-compute[75239]:       <nova:ports>
Nov 13 20:51:44 user nova-compute[75239]:         <nova:port uuid="26dcf975-7fd9-4712-8c74-625273620527">
Nov 13 20:51:44 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 20:51:44 user nova-compute[75239]:         </nova:port>
Nov 13 20:51:44 user nova-compute[75239]:       </nova:ports>
Nov 13 20:51:44 user nova-compute[75239]:     </nova:instance>
Nov 13 20:51:44 user nova-compute[75239]:   </metadata>
Nov 13 20:51:44 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:51:44 user nova-compute[75239]:     <system>
Nov 13 20:51:44 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:51:44 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:51:44 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:51:44 user nova-compute[75239]:       <entry name="serial">d05a4121-e321-432a-9f25-605ad901efdd</entry>
Nov 13 20:51:44 user nova-compute[75239]:       <entry name="uuid">d05a4121-e321-432a-9f25-605ad901efdd</entry>
Nov 13 20:51:44 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:51:44 user nova-compute[75239]:     </system>
Nov 13 20:51:44 user nova-compute[75239]:   </sysinfo>
Nov 13 20:51:44 user nova-compute[75239]:   <os>
Nov 13 20:51:44 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:51:44 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:51:44 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:51:44 user nova-compute[75239]:   </os>
Nov 13 20:51:44 user nova-compute[75239]:   <features>
Nov 13 20:51:44 user nova-compute[75239]:     <acpi/>
Nov 13 20:51:44 user nova-compute[75239]:     <apic/>
Nov 13 20:51:44 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:51:44 user nova-compute[75239]:   </features>
Nov 13 20:51:44 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:51:44 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:51:44 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:51:44 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:51:44 user nova-compute[75239]:   </clock>
Nov 13 20:51:44 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:51:44 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:51:44 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:51:44 user nova-compute[75239]:   </cpu>
Nov 13 20:51:44 user nova-compute[75239]:   <devices>
Nov 13 20:51:44 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:51:44 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:51:44 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk"/>
Nov 13 20:51:44 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:51:44 user nova-compute[75239]:     </disk>
Nov 13 20:51:44 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:51:44 user nova-compute[75239]:       <mac address="fa:16:3e:ff:4b:37"/>
Nov 13 20:51:44 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:51:44 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:51:44 user nova-compute[75239]:       <target dev="tap26dcf975-7f"/>
Nov 13 20:51:44 user nova-compute[75239]:     </interface>
Nov 13 20:51:44 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:51:44 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/console.log" append="off"/>
Nov 13 20:51:44 user nova-compute[75239]:     </serial>
Nov 13 20:51:44 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:51:44 user nova-compute[75239]:     <video>
Nov 13 20:51:44 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:51:44 user nova-compute[75239]:     </video>
Nov 13 20:51:44 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:51:44 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:51:44 user nova-compute[75239]:     </rng>
Nov 13 20:51:44 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:51:44 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:51:44 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:51:44 user nova-compute[75239]:     </memballoon>
Nov 13 20:51:44 user nova-compute[75239]:   </devices>
Nov 13 20:51:44 user nova-compute[75239]: </domain>
Nov 13 20:51:44 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:51:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1715884895',display_name='tempest-AttachVolumeNegativeTest-server-1715884895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1715884895',id=38,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW+TS9Id+FRGZR+s1PgLasaKlS1yZqd/+YwqsE9WJ8s9av/6rP87zwQSXwxe85SjPjb75w+e937v/6dmFqcN93kLROZ+sx0zDGtyVL+58SsiKfy84ZhegISL4svdYkpeg==',key_name='tempest-keypair-634537538',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-0iw7h0uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:51:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=d05a4121-e321-432a-9f25-605ad901efdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4b:37,bridge_name='br-int',has_traffic_filtering=True,id=26dcf975-7fd9-4712-8c74-625273620527,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dcf975-7f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG os_vif [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4b:37,bridge_name='br-int',has_traffic_filtering=True,id=26dcf975-7fd9-4712-8c74-625273620527,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dcf975-7f') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8c1cde4-9773-5e8f-87f6-7b955df5b684', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26dcf975-7f, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26dcf975-7f, col_values=(('qos', UUID('e97f6f74-97ca-4890-be0b-9520f46507e0')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26dcf975-7f, col_values=(('external_ids', {'iface-id': '26dcf975-7fd9-4712-8c74-625273620527', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:4b:37', 'vm-uuid': 'd05a4121-e321-432a-9f25-605ad901efdd'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:44 user nova-compute[75239]: INFO os_vif [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4b:37,bridge_name='br-int',has_traffic_filtering=True,id=26dcf975-7fd9-4712-8c74-625273620527,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dcf975-7f')
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No VIF found with MAC fa:16:3e:ff:4b:37, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-4ab6eaf1-0c76-41b8-9cb2-665e82e787dc req-9f6cb8e3-3bd5-41d4-bf98-f621f487b84c service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Updated VIF entry in instance network info cache for port 26dcf975-7fd9-4712-8c74-625273620527. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-4ab6eaf1-0c76-41b8-9cb2-665e82e787dc req-9f6cb8e3-3bd5-41d4-bf98-f621f487b84c service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Updating instance_info_cache with network_info: [{"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-4ab6eaf1-0c76-41b8-9cb2-665e82e787dc req-9f6cb8e3-3bd5-41d4-bf98-f621f487b84c service nova] Releasing lock "refresh_cache-d05a4121-e321-432a-9f25-605ad901efdd" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:45 user nova-compute[75239]: INFO nova.compute.manager [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Terminating instance
Nov 13 20:51:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a8ae5ca-b6b6-464d-a71e-44dea728cffd req-4a23b641-c328-4bbc-8a6d-3060f44eb016 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-unplugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a8ae5ca-b6b6-464d-a71e-44dea728cffd req-4a23b641-c328-4bbc-8a6d-3060f44eb016 service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a8ae5ca-b6b6-464d-a71e-44dea728cffd req-4a23b641-c328-4bbc-8a6d-3060f44eb016 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a8ae5ca-b6b6-464d-a71e-44dea728cffd req-4a23b641-c328-4bbc-8a6d-3060f44eb016 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a8ae5ca-b6b6-464d-a71e-44dea728cffd req-4a23b641-c328-4bbc-8a6d-3060f44eb016 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-unplugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a8ae5ca-b6b6-464d-a71e-44dea728cffd req-4a23b641-c328-4bbc-8a6d-3060f44eb016 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-unplugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:46 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance destroyed successfully.
Nov 13 20:51:46 user nova-compute[75239]: DEBUG nova.objects.instance [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'resources' on Instance uuid a9ed319e-d732-4930-89b4-7a61ea6cf930 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:45:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-311739780',display_name='tempest-ServerRescueNegativeTestJSON-server-311739780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-311739780',id=32,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQHU08M836BbGVao+ri5az9a01m1uenSgGJY98kRt5kmxA3tDm3mza3xC5VS+TtacpZ3tivyEPNeLEhfhn2gg2qW5JEYB4XVJ+T18O/ixYV7AxTWGA6aYw1su8KACIoNg==',key_name='tempest-keypair-1400005984',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-0yuevxk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:49:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b27083a4000d4ba2832a394b9140b530',uuid=a9ed319e-d732-4930-89b4-7a61ea6cf930,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "6675cf99-b5e8-402b-a98e-d4190071da32", "address": "fa:16:3e:f3:36:75", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6675cf99-b5", "ovs_interfaceid": "6675cf99-b5e8-402b-a98e-d4190071da32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:36:75,bridge_name='br-int',has_traffic_filtering=True,id=6675cf99-b5e8-402b-a98e-d4190071da32,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6675cf99-b5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG os_vif [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:36:75,bridge_name='br-int',has_traffic_filtering=True,id=6675cf99-b5e8-402b-a98e-d4190071da32,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6675cf99-b5') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6675cf99-b5, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=205e182b-2ebb-471c-9adc-87a2e9cbe38e) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:46 user nova-compute[75239]: INFO os_vif [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:36:75,bridge_name='br-int',has_traffic_filtering=True,id=6675cf99-b5e8-402b-a98e-d4190071da32,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6675cf99-b5')
Nov 13 20:51:46 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Deleting instance files /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930_del
Nov 13 20:51:46 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Deletion of /opt/stack/data/nova/instances/a9ed319e-d732-4930-89b4-7a61ea6cf930_del complete
Nov 13 20:51:46 user nova-compute[75239]: INFO nova.compute.manager [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 13 20:51:46 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:51:46 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:47 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Took 0.64 seconds to deallocate network for instance.
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-cd8b79ef-9b82-40cf-ac75-6ac70c9d70e8 req-53ee2eae-233e-4da7-8173-036c36cc1a38 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-deleted-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:47 user nova-compute[75239]: INFO nova.compute.manager [req-cd8b79ef-9b82-40cf-ac75-6ac70c9d70e8 req-53ee2eae-233e-4da7-8173-036c36cc1a38 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Neutron deleted interface 6675cf99-b5e8-402b-a98e-d4190071da32; detaching it from the instance and deleting it from the info cache
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-cd8b79ef-9b82-40cf-ac75-6ac70c9d70e8 req-53ee2eae-233e-4da7-8173-036c36cc1a38 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-cd8b79ef-9b82-40cf-ac75-6ac70c9d70e8 req-53ee2eae-233e-4da7-8173-036c36cc1a38 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Detach interface failed, port_id=6675cf99-b5e8-402b-a98e-d4190071da32, reason: Instance a9ed319e-d732-4930-89b4-7a61ea6cf930 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:47 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Deleted allocations for instance a9ed319e-d732-4930-89b4-7a61ea6cf930
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-a9ed319e-d732-4930-89b4-7a61ea6cf930" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-200c23a6-bcdb-478e-b1c5-9c4a137c1730 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.170s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] Acquiring lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] Lock "a9ed319e-d732-4930-89b4-7a61ea6cf930-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] No waiting events found dispatching network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:47 user nova-compute[75239]: WARNING nova.compute.manager [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] [instance: a9ed319e-d732-4930-89b4-7a61ea6cf930] Received unexpected event network-vif-plugged-6675cf99-b5e8-402b-a98e-d4190071da32 for instance with vm_state deleted and task_state None.
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] No waiting events found dispatching network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:47 user nova-compute[75239]: WARNING nova.compute.manager [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received unexpected event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 for instance with vm_state building and task_state spawning.
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] No waiting events found dispatching network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:47 user nova-compute[75239]: WARNING nova.compute.manager [req-53018705-15a1-4979-88a9-6957cde0f255 req-ac08cc26-9b61-48b7-a84e-e2086aeec636 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received unexpected event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 for instance with vm_state building and task_state spawning.
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:51:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Instance spawned successfully.
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:48 user nova-compute[75239]: INFO nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:51:48 user nova-compute[75239]: INFO nova.compute.manager [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Took 6.20 seconds to build instance.
Nov 13 20:51:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f8d4459-4f23-4b0b-9b08-5a4639965e56 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "d05a4121-e321-432a-9f25-605ad901efdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.304s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquiring lock "20af452b-8d73-42f4-8030-b6f488642876" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "20af452b-8d73-42f4-8030-b6f488642876" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquiring lock "20af452b-8d73-42f4-8030-b6f488642876-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:48 user nova-compute[75239]: INFO nova.compute.manager [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Terminating instance
Nov 13 20:51:48 user nova-compute[75239]: DEBUG nova.compute.manager [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-fe297d25-6b71-4918-8ec2-ef9e7a8d4be2 req-4672b1dd-d89b-4481-bb96-66c97af340fd service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received event network-vif-unplugged-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe297d25-6b71-4918-8ec2-ef9e7a8d4be2 req-4672b1dd-d89b-4481-bb96-66c97af340fd service nova] Acquiring lock "20af452b-8d73-42f4-8030-b6f488642876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe297d25-6b71-4918-8ec2-ef9e7a8d4be2 req-4672b1dd-d89b-4481-bb96-66c97af340fd service nova] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe297d25-6b71-4918-8ec2-ef9e7a8d4be2 req-4672b1dd-d89b-4481-bb96-66c97af340fd service nova] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-fe297d25-6b71-4918-8ec2-ef9e7a8d4be2 req-4672b1dd-d89b-4481-bb96-66c97af340fd service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] No waiting events found dispatching network-vif-unplugged-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-fe297d25-6b71-4918-8ec2-ef9e7a8d4be2 req-4672b1dd-d89b-4481-bb96-66c97af340fd service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received event network-vif-unplugged-4108eedc-7fc3-4282-a085-894876e35493 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:51:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Instance destroyed successfully.
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.objects.instance [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lazy-loading 'resources' on Instance uuid 20af452b-8d73-42f4-8030-b6f488642876 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:49:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-61140831',display_name='tempest-VolumesNegativeTest-instance-61140831',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-61140831',id=36,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:50:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78bcf1439e0740b494496ee7d6b303a1',ramdisk_id='',reservation_id='r-8xnphw03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-53094924',owner_user_name='tempest-VolumesNegativeTest-53094924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:50:05Z,user_data=None,user_id='eea5464c85504c0daa21a5ec35b3a456',uuid=20af452b-8d73-42f4-8030-b6f488642876,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Converting VIF {"id": "4108eedc-7fc3-4282-a085-894876e35493", "address": "fa:16:3e:56:3c:bc", "network": {"id": "a64638ab-9dc0-4f12-afef-41dc9593b48d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "d921943282b34576a1b595bddf0e78cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4108eedc-7f", "ovs_interfaceid": "4108eedc-7fc3-4282-a085-894876e35493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=4108eedc-7fc3-4282-a085-894876e35493,network=Network(a64638ab-9dc0-4f12-afef-41dc9593b48d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4108eedc-7f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG os_vif [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=4108eedc-7fc3-4282-a085-894876e35493,network=Network(a64638ab-9dc0-4f12-afef-41dc9593b48d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4108eedc-7f') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4108eedc-7f, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33de37ec-7f4a-40e9-ba64-744446ec20c0) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:51:49 user nova-compute[75239]: INFO os_vif [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:3c:bc,bridge_name='br-int',has_traffic_filtering=True,id=4108eedc-7fc3-4282-a085-894876e35493,network=Network(a64638ab-9dc0-4f12-afef-41dc9593b48d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4108eedc-7f')
Nov 13 20:51:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Deleting instance files /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876_del
Nov 13 20:51:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Deletion of /opt/stack/data/nova/instances/20af452b-8d73-42f4-8030-b6f488642876_del complete
Nov 13 20:51:49 user nova-compute[75239]: INFO nova.compute.manager [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 13 20:51:49 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 20af452b-8d73-42f4-8030-b6f488642876] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:49 user nova-compute[75239]: INFO nova.compute.manager [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Terminating instance
Nov 13 20:51:49 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-988b6ba9-b02e-48c5-8fdf-dd0c6994e4b4 req-dc7b23b5-2140-40d1-bf96-d996c391efff service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received event network-vif-deleted-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:50 user nova-compute[75239]: INFO nova.compute.manager [req-988b6ba9-b02e-48c5-8fdf-dd0c6994e4b4 req-dc7b23b5-2140-40d1-bf96-d996c391efff service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Neutron deleted interface 4108eedc-7fc3-4282-a085-894876e35493; detaching it from the instance and deleting it from the info cache
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.network.neutron [req-988b6ba9-b02e-48c5-8fdf-dd0c6994e4b4 req-dc7b23b5-2140-40d1-bf96-d996c391efff service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:50 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Took 0.52 seconds to deallocate network for instance.
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-988b6ba9-b02e-48c5-8fdf-dd0c6994e4b4 req-dc7b23b5-2140-40d1-bf96-d996c391efff service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Detach interface failed, port_id=4108eedc-7fc3-4282-a085-894876e35493, reason: Instance 20af452b-8d73-42f4-8030-b6f488642876 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:50 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Deleted allocations for instance 20af452b-8d73-42f4-8030-b6f488642876
Nov 13 20:51:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-178781d9-a77b-44f2-9b16-9be768cf3519 tempest-VolumesNegativeTest-53094924 tempest-VolumesNegativeTest-53094924-project-member] Lock "20af452b-8d73-42f4-8030-b6f488642876" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.791s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:50 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Instance destroyed successfully.
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.objects.instance [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lazy-loading 'resources' on Instance uuid be0bf428-fadf-4e08-87ac-9563fb31d1b8 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:47:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-431686731',display_name='tempest-TestMinimumBasicScenario-server-431686731',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-431686731',id=33,image_ref='f5cc642c-0663-44cc-9cc2-4c6659b2ab71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFcsH7r519PkQvflkhw6qSX6W8iCUEZBEh1ME3k5YxiuL1nIfb8ETuQ2q8+6B4hJrr/Ze/4qiKJOORCnj4QBNKNh+lg4ne/iMCRaR21AcsuaonRWw4dwWV3zogFF+kU8A==',key_name='tempest-TestMinimumBasicScenario-1595131035',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:47:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='53fd8f58057142af8d76c28d6b7b70c6',ramdisk_id='',reservation_id='r-ja578va6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f5cc642c-0663-44cc-9cc2-4c6659b2ab71',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-168427819',owner_user_name='tempest-TestMinimumBasicScenario-168427819-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:49:13Z,user_data=None,user_id='6abaa983d703498f9bcd47764794423c',uuid=be0bf428-fadf-4e08-87ac-9563fb31d1b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converting VIF {"id": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "address": "fa:16:3e:1b:9e:7d", "network": {"id": "5892697a-45af-46fe-a433-d81bd3f0e8e4", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-136950499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "53fd8f58057142af8d76c28d6b7b70c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b5756c-5c", "ovs_interfaceid": "50b5756c-5cce-4cb1-94f0-6283cdc80052", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=50b5756c-5cce-4cb1-94f0-6283cdc80052,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b5756c-5c') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG os_vif [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=50b5756c-5cce-4cb1-94f0-6283cdc80052,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b5756c-5c') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50b5756c-5c, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cba026fe-8382-4b1f-b573-66ebed7fe1be) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:51:50 user nova-compute[75239]: INFO os_vif [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:9e:7d,bridge_name='br-int',has_traffic_filtering=True,id=50b5756c-5cce-4cb1-94f0-6283cdc80052,network=Network(5892697a-45af-46fe-a433-d81bd3f0e8e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b5756c-5c')
Nov 13 20:51:50 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Deleting instance files /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8_del
Nov 13 20:51:50 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Deletion of /opt/stack/data/nova/instances/be0bf428-fadf-4e08-87ac-9563fb31d1b8_del complete
Nov 13 20:51:50 user nova-compute[75239]: INFO nova.compute.manager [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 13 20:51:50 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:51:50 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:51:51 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Took 0.44 seconds to deallocate network for instance.
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received event network-vif-plugged-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] Acquiring lock "20af452b-8d73-42f4-8030-b6f488642876-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] Lock "20af452b-8d73-42f4-8030-b6f488642876-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] No waiting events found dispatching network-vif-plugged-4108eedc-7fc3-4282-a085-894876e35493 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:51 user nova-compute[75239]: WARNING nova.compute.manager [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] [instance: 20af452b-8d73-42f4-8030-b6f488642876] Received unexpected event network-vif-plugged-4108eedc-7fc3-4282-a085-894876e35493 for instance with vm_state deleted and task_state None.
Nov 13 20:51:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-vif-unplugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] No waiting events found dispatching network-vif-unplugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:51 user nova-compute[75239]: WARNING nova.compute.manager [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received unexpected event network-vif-unplugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 for instance with vm_state deleted and task_state None.
Nov 13 20:51:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] Acquiring lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG nova.compute.manager [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] No waiting events found dispatching network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:51:51 user nova-compute[75239]: WARNING nova.compute.manager [req-bfaf8a29-85dd-47d9-89ad-99a6882089b2 req-ce56a832-6de8-4cdc-b16a-24a0124ba493 service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received unexpected event network-vif-plugged-50b5756c-5cce-4cb1-94f0-6283cdc80052 for instance with vm_state deleted and task_state None.
Nov 13 20:51:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:51 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Deleted allocations for instance be0bf428-fadf-4e08-87ac-9563fb31d1b8
Nov 13 20:51:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1b25924d-4bdc-470d-ac83-a503a14da6bd tempest-TestMinimumBasicScenario-168427819 tempest-TestMinimumBasicScenario-168427819-project-member] Lock "be0bf428-fadf-4e08-87ac-9563fb31d1b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.864s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:51:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-2f93d6f4-62e2-4679-a95b-84857dc63bd8 req-7bceed3e-2516-4990-b5f5-46f50e08104c service nova] [instance: be0bf428-fadf-4e08-87ac-9563fb31d1b8] Received event network-vif-deleted-50b5756c-5cce-4cb1-94f0-6283cdc80052 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:51:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:52:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:12 user nova-compute[75239]: INFO nova.compute.manager [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Terminating instance
Nov 13 20:52:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-0655f0d7-237f-4860-981c-f8e9a0143b3b req-07449358-6436-4c7f-8a09-c71b8d3b0c40 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received event network-vif-unplugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0655f0d7-237f-4860-981c-f8e9a0143b3b req-07449358-6436-4c7f-8a09-c71b8d3b0c40 service nova] Acquiring lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0655f0d7-237f-4860-981c-f8e9a0143b3b req-07449358-6436-4c7f-8a09-c71b8d3b0c40 service nova] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0655f0d7-237f-4860-981c-f8e9a0143b3b req-07449358-6436-4c7f-8a09-c71b8d3b0c40 service nova] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-0655f0d7-237f-4860-981c-f8e9a0143b3b req-07449358-6436-4c7f-8a09-c71b8d3b0c40 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] No waiting events found dispatching network-vif-unplugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-0655f0d7-237f-4860-981c-f8e9a0143b3b req-07449358-6436-4c7f-8a09-c71b8d3b0c40 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received event network-vif-unplugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:52:12 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Instance destroyed successfully.
Nov 13 20:52:12 user nova-compute[75239]: DEBUG nova.objects.instance [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lazy-loading 'resources' on Instance uuid d816fbc5-c148-472b-9ade-c0175ccb38e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:32:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-38824528',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-38824528',id=4,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:32:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f465510aec2849dfb0917120a772f066',ramdisk_id='',reservation_id='r-xb41uftk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:34:32Z,user_data=None,user_id='2669d647fe6f4034bc70703546345eb3',uuid=d816fbc5-c148-472b-9ade-c0175ccb38e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converting VIF {"id": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "address": "fa:16:3e:c3:4d:66", "network": {"id": "b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-403106044-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f465510aec2849dfb0917120a772f066", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap300851ce-3a", "ovs_interfaceid": "300851ce-3a22-4abf-a2b6-4a3d5bde094e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=300851ce-3a22-4abf-a2b6-4a3d5bde094e,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300851ce-3a') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG os_vif [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=300851ce-3a22-4abf-a2b6-4a3d5bde094e,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300851ce-3a') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap300851ce-3a, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9161d32b-a0ef-416a-8dea-430862a9d78f) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:12 user nova-compute[75239]: INFO os_vif [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:4d:66,bridge_name='br-int',has_traffic_filtering=True,id=300851ce-3a22-4abf-a2b6-4a3d5bde094e,network=Network(b9df29a8-0ef4-49cf-9e5e-761c9acd4fdb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap300851ce-3a')
Nov 13 20:52:12 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Deleting instance files /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0_del
Nov 13 20:52:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Deletion of /opt/stack/data/nova/instances/d816fbc5-c148-472b-9ade-c0175ccb38e0_del complete
Nov 13 20:52:13 user nova-compute[75239]: INFO nova.compute.manager [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 13 20:52:13 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:52:13 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:52:13 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:52:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:13 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:52:13 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Took 0.42 seconds to deallocate network for instance.
Nov 13 20:52:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:13 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:52:13 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:52:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:13 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Deleted allocations for instance d816fbc5-c148-472b-9ade-c0175ccb38e0
Nov 13 20:52:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f3614abc-9243-4057-b65f-0e345747f92c tempest-ServerBootFromVolumeStableRescueTest-2033691872 tempest-ServerBootFromVolumeStableRescueTest-2033691872-project-member] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.543s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-a364fbb2-f227-41f3-a157-376cd5b38441 req-5766f313-b4e8-407d-a882-b8b21ca37c56 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received event network-vif-plugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a364fbb2-f227-41f3-a157-376cd5b38441 req-5766f313-b4e8-407d-a882-b8b21ca37c56 service nova] Acquiring lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a364fbb2-f227-41f3-a157-376cd5b38441 req-5766f313-b4e8-407d-a882-b8b21ca37c56 service nova] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a364fbb2-f227-41f3-a157-376cd5b38441 req-5766f313-b4e8-407d-a882-b8b21ca37c56 service nova] Lock "d816fbc5-c148-472b-9ade-c0175ccb38e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-a364fbb2-f227-41f3-a157-376cd5b38441 req-5766f313-b4e8-407d-a882-b8b21ca37c56 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] No waiting events found dispatching network-vif-plugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:14 user nova-compute[75239]: WARNING nova.compute.manager [req-a364fbb2-f227-41f3-a157-376cd5b38441 req-5766f313-b4e8-407d-a882-b8b21ca37c56 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received unexpected event network-vif-plugged-300851ce-3a22-4abf-a2b6-4a3d5bde094e for instance with vm_state deleted and task_state None.
Nov 13 20:52:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-a364fbb2-f227-41f3-a157-376cd5b38441 req-5766f313-b4e8-407d-a882-b8b21ca37c56 service nova] [instance: d816fbc5-c148-472b-9ade-c0175ccb38e0] Received event network-vif-deleted-300851ce-3a22-4abf-a2b6-4a3d5bde094e {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "ef944343-26de-4b6f-a3de-031e25680346" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:16 user nova-compute[75239]: INFO nova.compute.manager [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Terminating instance
Nov 13 20:52:16 user nova-compute[75239]: DEBUG nova.compute.manager [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:52:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-26bb27f4-dbe3-4a88-9267-dda197c96b14 req-a153e07c-652e-4f18-bf81-abeac794bec3 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-unplugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-26bb27f4-dbe3-4a88-9267-dda197c96b14 req-a153e07c-652e-4f18-bf81-abeac794bec3 service nova] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-26bb27f4-dbe3-4a88-9267-dda197c96b14 req-a153e07c-652e-4f18-bf81-abeac794bec3 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-26bb27f4-dbe3-4a88-9267-dda197c96b14 req-a153e07c-652e-4f18-bf81-abeac794bec3 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-26bb27f4-dbe3-4a88-9267-dda197c96b14 req-a153e07c-652e-4f18-bf81-abeac794bec3 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] No waiting events found dispatching network-vif-unplugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-26bb27f4-dbe3-4a88-9267-dda197c96b14 req-a153e07c-652e-4f18-bf81-abeac794bec3 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-unplugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ef944343-26de-4b6f-a3de-031e25680346] Instance destroyed successfully.
Nov 13 20:52:17 user nova-compute[75239]: DEBUG nova.objects.instance [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lazy-loading 'resources' on Instance uuid ef944343-26de-4b6f-a3de-031e25680346 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1739935053',display_name='tempest-VolumesActionsTest-instance-1739935053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1739935053',id=37,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:50:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dc2074bf752f49f58f8ccc88a33b6309',ramdisk_id='',reservation_id='r-bighb8cw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1662331085',owner_user_name='tempest-VolumesActionsTest-1662331085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:50:32Z,user_data=None,user_id='8b99b7e2d05b45b3855c6d4debeb46a2',uuid=ef944343-26de-4b6f-a3de-031e25680346,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "address": "fa:16:3e:8a:20:ba", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef6c28b-1e", "ovs_interfaceid": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converting VIF {"id": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "address": "fa:16:3e:8a:20:ba", "network": {"id": "e9ce7d5c-79c4-406f-9271-cb57bd4ac82f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1553352850-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dc2074bf752f49f58f8ccc88a33b6309", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeef6c28b-1e", "ovs_interfaceid": "eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:20:ba,bridge_name='br-int',has_traffic_filtering=True,id=eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef6c28b-1e') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG os_vif [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:20:ba,bridge_name='br-int',has_traffic_filtering=True,id=eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef6c28b-1e') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeef6c28b-1e, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74a04407-bd9e-44ec-8ffe-61b40f0be8e9) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: INFO os_vif [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:20:ba,bridge_name='br-int',has_traffic_filtering=True,id=eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d,network=Network(e9ce7d5c-79c4-406f-9271-cb57bd4ac82f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeef6c28b-1e')
Nov 13 20:52:17 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Deleting instance files /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346_del
Nov 13 20:52:17 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Deletion of /opt/stack/data/nova/instances/ef944343-26de-4b6f-a3de-031e25680346_del complete
Nov 13 20:52:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:17 user nova-compute[75239]: INFO nova.compute.manager [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] [instance: ef944343-26de-4b6f-a3de-031e25680346] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 13 20:52:17 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: ef944343-26de-4b6f-a3de-031e25680346] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:52:17 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ef944343-26de-4b6f-a3de-031e25680346] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ef944343-26de-4b6f-a3de-031e25680346] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:52:18 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: ef944343-26de-4b6f-a3de-031e25680346] Took 0.81 seconds to deallocate network for instance.
Nov 13 20:52:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-ae9f9475-3eb7-44a4-bcbd-2283e39130f5 req-c0d1e1b8-c193-4d6e-8880-3bfbd04e974f service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-deleted-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:18 user nova-compute[75239]: INFO nova.compute.manager [req-ae9f9475-3eb7-44a4-bcbd-2283e39130f5 req-c0d1e1b8-c193-4d6e-8880-3bfbd04e974f service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Neutron deleted interface eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d; detaching it from the instance and deleting it from the info cache
Nov 13 20:52:18 user nova-compute[75239]: DEBUG nova.network.neutron [req-ae9f9475-3eb7-44a4-bcbd-2283e39130f5 req-c0d1e1b8-c193-4d6e-8880-3bfbd04e974f service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-ae9f9475-3eb7-44a4-bcbd-2283e39130f5 req-c0d1e1b8-c193-4d6e-8880-3bfbd04e974f service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Detach interface failed, port_id=eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d, reason: Instance ef944343-26de-4b6f-a3de-031e25680346 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:52:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:18 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Deleted allocations for instance ef944343-26de-4b6f-a3de-031e25680346
Nov 13 20:52:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-e490a1b6-c9e9-4963-a5c2-bb84ba8fbd38 tempest-VolumesActionsTest-1662331085 tempest-VolumesActionsTest-1662331085-project-member] Lock "ef944343-26de-4b6f-a3de-031e25680346" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.194s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] No waiting events found dispatching network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:19 user nova-compute[75239]: WARNING nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received unexpected event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d for instance with vm_state deleted and task_state None.
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] No waiting events found dispatching network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:19 user nova-compute[75239]: WARNING nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received unexpected event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d for instance with vm_state deleted and task_state None.
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] No waiting events found dispatching network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:19 user nova-compute[75239]: WARNING nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received unexpected event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d for instance with vm_state deleted and task_state None.
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-unplugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] No waiting events found dispatching network-vif-unplugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:19 user nova-compute[75239]: WARNING nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received unexpected event network-vif-unplugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d for instance with vm_state deleted and task_state None.
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Acquiring lock "ef944343-26de-4b6f-a3de-031e25680346-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] Lock "ef944343-26de-4b6f-a3de-031e25680346-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] No waiting events found dispatching network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:19 user nova-compute[75239]: WARNING nova.compute.manager [req-8f8eaf66-b5f8-489e-80cb-e8eb86c873e8 req-272e43e9-a3e8-472b-828b-cd7822ee2cd6 service nova] [instance: ef944343-26de-4b6f-a3de-031e25680346] Received unexpected event network-vif-plugged-eef6c28b-1eeb-4c1f-b3a5-eacd2efa163d for instance with vm_state deleted and task_state None.
Nov 13 20:52:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "c0591fd1-adfd-4626-806a-a71f46c80400" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "c0591fd1-adfd-4626-806a-a71f46c80400" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:52:27 user nova-compute[75239]: INFO nova.compute.claims [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Claim successful on node user
Nov 13 20:52:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.network.neutron [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:52:27 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.policy [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e79a6935af1f47cebd04dcb0ec9e487e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b57945a52486a96a05958d9850e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:52:27 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Creating image(s)
Nov 13 20:52:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "/opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "/opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:27 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk 1073741824" returned: 0 in 0.050s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG nova.network.neutron [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Successfully created port: acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Cannot resize image /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Ensure instance console log exists: /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.neutron [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Successfully updated port: acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquired lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.neutron [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-185f37d2-7b6e-4e0a-8f85-cf31cf753de1 req-609e756c-e483-493d-9e41-838a97daf495 service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received event network-changed-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-185f37d2-7b6e-4e0a-8f85-cf31cf753de1 req-609e756c-e483-493d-9e41-838a97daf495 service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Refreshing instance network info cache due to event network-changed-acf81d52-e4ae-4c10-b0c3-7874a29f13b8. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-185f37d2-7b6e-4e0a-8f85-cf31cf753de1 req-609e756c-e483-493d-9e41-838a97daf495 service nova] Acquiring lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.neutron [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.neutron [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updating instance_info_cache with network_info: [{"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Releasing lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Instance network_info: |[{"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-185f37d2-7b6e-4e0a-8f85-cf31cf753de1 req-609e756c-e483-493d-9e41-838a97daf495 service nova] Acquired lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.neutron [req-185f37d2-7b6e-4e0a-8f85-cf31cf753de1 req-609e756c-e483-493d-9e41-838a97daf495 service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Refreshing network info cache for port acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Start _get_guest_xml network_info=[{"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:52:29 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:52:29 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1213810461',display_name='tempest-ServersNegativeTestJSON-server-1213810461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1213810461',id=39,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='617b57945a52486a96a05958d9850e06',ramdisk_id='',reservation_id='r-ewiopi0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-462526943',owner_user_name='tempest-ServersNegativeTestJSON-462526943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:52:28Z,user_data=None,user_id='e79a6935af1f47cebd04dcb0ec9e487e',uuid=c0591fd1-adfd-4626-806a-a71f46c80400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converting VIF {"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:17:f4,bridge_name='br-int',has_traffic_filtering=True,id=acf81d52-e4ae-4c10-b0c3-7874a29f13b8,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf81d52-e4') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.objects.instance [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lazy-loading 'pci_devices' on Instance uuid c0591fd1-adfd-4626-806a-a71f46c80400 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:52:29 user nova-compute[75239]:   <uuid>c0591fd1-adfd-4626-806a-a71f46c80400</uuid>
Nov 13 20:52:29 user nova-compute[75239]:   <name>instance-00000027</name>
Nov 13 20:52:29 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:52:29 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:52:29 user nova-compute[75239]:   <metadata>
Nov 13 20:52:29 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:52:29 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:52:29 user nova-compute[75239]:       <nova:name>tempest-ServersNegativeTestJSON-server-1213810461</nova:name>
Nov 13 20:52:29 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:52:29</nova:creationTime>
Nov 13 20:52:29 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:52:29 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:52:29 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:52:29 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:52:29 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:52:29 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:52:29 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:52:29 user nova-compute[75239]:       <nova:owner>
Nov 13 20:52:29 user nova-compute[75239]:         <nova:user uuid="e79a6935af1f47cebd04dcb0ec9e487e">tempest-ServersNegativeTestJSON-462526943-project-member</nova:user>
Nov 13 20:52:29 user nova-compute[75239]:         <nova:project uuid="617b57945a52486a96a05958d9850e06">tempest-ServersNegativeTestJSON-462526943</nova:project>
Nov 13 20:52:29 user nova-compute[75239]:       </nova:owner>
Nov 13 20:52:29 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:52:29 user nova-compute[75239]:       <nova:ports>
Nov 13 20:52:29 user nova-compute[75239]:         <nova:port uuid="acf81d52-e4ae-4c10-b0c3-7874a29f13b8">
Nov 13 20:52:29 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:52:29 user nova-compute[75239]:         </nova:port>
Nov 13 20:52:29 user nova-compute[75239]:       </nova:ports>
Nov 13 20:52:29 user nova-compute[75239]:     </nova:instance>
Nov 13 20:52:29 user nova-compute[75239]:   </metadata>
Nov 13 20:52:29 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:52:29 user nova-compute[75239]:     <system>
Nov 13 20:52:29 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:52:29 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:52:29 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:52:29 user nova-compute[75239]:       <entry name="serial">c0591fd1-adfd-4626-806a-a71f46c80400</entry>
Nov 13 20:52:29 user nova-compute[75239]:       <entry name="uuid">c0591fd1-adfd-4626-806a-a71f46c80400</entry>
Nov 13 20:52:29 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:52:29 user nova-compute[75239]:     </system>
Nov 13 20:52:29 user nova-compute[75239]:   </sysinfo>
Nov 13 20:52:29 user nova-compute[75239]:   <os>
Nov 13 20:52:29 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:52:29 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:52:29 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:52:29 user nova-compute[75239]:   </os>
Nov 13 20:52:29 user nova-compute[75239]:   <features>
Nov 13 20:52:29 user nova-compute[75239]:     <acpi/>
Nov 13 20:52:29 user nova-compute[75239]:     <apic/>
Nov 13 20:52:29 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:52:29 user nova-compute[75239]:   </features>
Nov 13 20:52:29 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:52:29 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:52:29 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:52:29 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:52:29 user nova-compute[75239]:   </clock>
Nov 13 20:52:29 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:52:29 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:52:29 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:52:29 user nova-compute[75239]:   </cpu>
Nov 13 20:52:29 user nova-compute[75239]:   <devices>
Nov 13 20:52:29 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:52:29 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:52:29 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk"/>
Nov 13 20:52:29 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:52:29 user nova-compute[75239]:     </disk>
Nov 13 20:52:29 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:52:29 user nova-compute[75239]:       <mac address="fa:16:3e:9e:17:f4"/>
Nov 13 20:52:29 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:52:29 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:52:29 user nova-compute[75239]:       <target dev="tapacf81d52-e4"/>
Nov 13 20:52:29 user nova-compute[75239]:     </interface>
Nov 13 20:52:29 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:52:29 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/console.log" append="off"/>
Nov 13 20:52:29 user nova-compute[75239]:     </serial>
Nov 13 20:52:29 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:52:29 user nova-compute[75239]:     <video>
Nov 13 20:52:29 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:52:29 user nova-compute[75239]:     </video>
Nov 13 20:52:29 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:52:29 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:52:29 user nova-compute[75239]:     </rng>
Nov 13 20:52:29 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:52:29 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:52:29 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:52:29 user nova-compute[75239]:     </memballoon>
Nov 13 20:52:29 user nova-compute[75239]:   </devices>
Nov 13 20:52:29 user nova-compute[75239]: </domain>
Nov 13 20:52:29 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1213810461',display_name='tempest-ServersNegativeTestJSON-server-1213810461',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1213810461',id=39,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='617b57945a52486a96a05958d9850e06',ramdisk_id='',reservation_id='r-ewiopi0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-462526943',owner_user_name='tempest-ServersNegativeTestJSON-462526943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:52:28Z,user_data=None,user_id='e79a6935af1f47cebd04dcb0ec9e487e',uuid=c0591fd1-adfd-4626-806a-a71f46c80400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converting VIF {"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:17:f4,bridge_name='br-int',has_traffic_filtering=True,id=acf81d52-e4ae-4c10-b0c3-7874a29f13b8,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf81d52-e4') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG os_vif [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:17:f4,bridge_name='br-int',has_traffic_filtering=True,id=acf81d52-e4ae-4c10-b0c3-7874a29f13b8,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf81d52-e4') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4aba52ec-4420-52f2-9631-a1cc2595d85e', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapacf81d52-e4, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapacf81d52-e4, col_values=(('qos', UUID('4f1d6f62-df83-474e-a79d-3ed7d848e2e2')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapacf81d52-e4, col_values=(('external_ids', {'iface-id': 'acf81d52-e4ae-4c10-b0c3-7874a29f13b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:17:f4', 'vm-uuid': 'c0591fd1-adfd-4626-806a-a71f46c80400'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:29 user nova-compute[75239]: INFO os_vif [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:17:f4,bridge_name='br-int',has_traffic_filtering=True,id=acf81d52-e4ae-4c10-b0c3-7874a29f13b8,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf81d52-e4')
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] No VIF found with MAC fa:16:3e:9e:17:f4, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.neutron [req-185f37d2-7b6e-4e0a-8f85-cf31cf753de1 req-609e756c-e483-493d-9e41-838a97daf495 service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updated VIF entry in instance network info cache for port acf81d52-e4ae-4c10-b0c3-7874a29f13b8. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG nova.network.neutron [req-185f37d2-7b6e-4e0a-8f85-cf31cf753de1 req-609e756c-e483-493d-9e41-838a97daf495 service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updating instance_info_cache with network_info: [{"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:52:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-185f37d2-7b6e-4e0a-8f85-cf31cf753de1 req-609e756c-e483-493d-9e41-838a97daf495 service nova] Releasing lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:52:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-75b25958-5f15-4261-a997-124ec27c3c2c req-57508e22-1b06-4957-81a9-6327ad3bab4a service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received event network-vif-plugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-75b25958-5f15-4261-a997-124ec27c3c2c req-57508e22-1b06-4957-81a9-6327ad3bab4a service nova] Acquiring lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-75b25958-5f15-4261-a997-124ec27c3c2c req-57508e22-1b06-4957-81a9-6327ad3bab4a service nova] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-75b25958-5f15-4261-a997-124ec27c3c2c req-57508e22-1b06-4957-81a9-6327ad3bab4a service nova] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-75b25958-5f15-4261-a997-124ec27c3c2c req-57508e22-1b06-4957-81a9-6327ad3bab4a service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] No waiting events found dispatching network-vif-plugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:31 user nova-compute[75239]: WARNING nova.compute.manager [req-75b25958-5f15-4261-a997-124ec27c3c2c req-57508e22-1b06-4957-81a9-6327ad3bab4a service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received unexpected event network-vif-plugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 for instance with vm_state building and task_state spawning.
Nov 13 20:52:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:52:32 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Instance spawned successfully.
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:52:32 user nova-compute[75239]: INFO nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 13 20:52:32 user nova-compute[75239]: DEBUG nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:52:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-2d462f2e-f563-4bfd-ba6a-f6ee760eeb2f req-040fb4f4-1c0b-4d71-9662-73f8efa344b4 service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received event network-vif-plugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2d462f2e-f563-4bfd-ba6a-f6ee760eeb2f req-040fb4f4-1c0b-4d71-9662-73f8efa344b4 service nova] Acquiring lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2d462f2e-f563-4bfd-ba6a-f6ee760eeb2f req-040fb4f4-1c0b-4d71-9662-73f8efa344b4 service nova] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2d462f2e-f563-4bfd-ba6a-f6ee760eeb2f req-040fb4f4-1c0b-4d71-9662-73f8efa344b4 service nova] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-2d462f2e-f563-4bfd-ba6a-f6ee760eeb2f req-040fb4f4-1c0b-4d71-9662-73f8efa344b4 service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] No waiting events found dispatching network-vif-plugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:33 user nova-compute[75239]: WARNING nova.compute.manager [req-2d462f2e-f563-4bfd-ba6a-f6ee760eeb2f req-040fb4f4-1c0b-4d71-9662-73f8efa344b4 service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received unexpected event network-vif-plugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 for instance with vm_state building and task_state spawning.
Nov 13 20:52:33 user nova-compute[75239]: INFO nova.compute.manager [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Took 5.76 seconds to build instance.
Nov 13 20:52:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-df87842f-4e7c-4028-b5c7-7af23e46e704 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "c0591fd1-adfd-4626-806a-a71f46c80400" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.854s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:39 user nova-compute[75239]: INFO nova.compute.manager [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Terminating instance
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-590905d0-6cfd-4910-b408-d9465eb9d511 req-83ef0d03-7802-46d2-8317-8ef036c84850 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-unplugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-590905d0-6cfd-4910-b408-d9465eb9d511 req-83ef0d03-7802-46d2-8317-8ef036c84850 service nova] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-590905d0-6cfd-4910-b408-d9465eb9d511 req-83ef0d03-7802-46d2-8317-8ef036c84850 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-590905d0-6cfd-4910-b408-d9465eb9d511 req-83ef0d03-7802-46d2-8317-8ef036c84850 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-590905d0-6cfd-4910-b408-d9465eb9d511 req-83ef0d03-7802-46d2-8317-8ef036c84850 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] No waiting events found dispatching network-vif-unplugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-590905d0-6cfd-4910-b408-d9465eb9d511 req-83ef0d03-7802-46d2-8317-8ef036c84850 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-unplugged-480fb2da-ad24-40ae-8586-d9050eca6899 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:39 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Instance destroyed successfully.
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'resources' on Instance uuid 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1355998343',display_name='tempest-ServerRescueNegativeTestJSON-server-1355998343',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1355998343',id=18,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:38:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-rx1jyauh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:38:43Z,user_data=None,user_id='b27083a4000d4ba2832a394b9140b530',uuid=3cbf6e73-bc09-4e1f-b249-261f0534c6e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "480fb2da-ad24-40ae-8586-d9050eca6899", "address": "fa:16:3e:e5:5d:ad", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480fb2da-ad", "ovs_interfaceid": "480fb2da-ad24-40ae-8586-d9050eca6899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:5d:ad,bridge_name='br-int',has_traffic_filtering=True,id=480fb2da-ad24-40ae-8586-d9050eca6899,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480fb2da-ad') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG os_vif [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:5d:ad,bridge_name='br-int',has_traffic_filtering=True,id=480fb2da-ad24-40ae-8586-d9050eca6899,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480fb2da-ad') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap480fb2da-ad, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=853be5a8-a1b9-4135-a0b6-7446ba32ff07) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:39 user nova-compute[75239]: INFO os_vif [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:5d:ad,bridge_name='br-int',has_traffic_filtering=True,id=480fb2da-ad24-40ae-8586-d9050eca6899,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480fb2da-ad')
Nov 13 20:52:39 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Deleting instance files /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0_del
Nov 13 20:52:39 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Deletion of /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0_del complete
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json" returned: 1 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue --force-share --output=json' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:52:39 user nova-compute[75239]: INFO nova.compute.manager [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:52:39 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000012, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/3cbf6e73-bc09-4e1f-b249-261f0534c6e0/disk.rescue
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-0b30eeab-9313-40ad-88db-7c19073f8d4a req-d6f8dc64-1b00-4ace-be13-f9b4cdc64480 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-deleted-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:40 user nova-compute[75239]: INFO nova.compute.manager [req-0b30eeab-9313-40ad-88db-7c19073f8d4a req-d6f8dc64-1b00-4ace-be13-f9b4cdc64480 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Neutron deleted interface 480fb2da-ad24-40ae-8586-d9050eca6899; detaching it from the instance and deleting it from the info cache
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.network.neutron [req-0b30eeab-9313-40ad-88db-7c19073f8d4a req-d6f8dc64-1b00-4ace-be13-f9b4cdc64480 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:52:40 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:52:40 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8390MB free_disk=24.928237915039062GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:40 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Took 0.84 seconds to deallocate network for instance.
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.manager [req-0b30eeab-9313-40ad-88db-7c19073f8d4a req-d6f8dc64-1b00-4ace-be13-f9b4cdc64480 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Detach interface failed, port_id=480fb2da-ad24-40ae-8586-d9050eca6899, reason: Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance d05a4121-e321-432a-9f25-605ad901efdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c0591fd1-adfd-4626-806a-a71f46c80400 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.266s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:41 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:52:41 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:52:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:41 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Deleted allocations for instance 3cbf6e73-bc09-4e1f-b249-261f0534c6e0
Nov 13 20:52:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-14e5e4c7-14f8-4e98-9aac-032c9e9510fb req-4490e6b9-dee1-4180-8c78-a15fca61afa3 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:52:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-14e5e4c7-14f8-4e98-9aac-032c9e9510fb req-4490e6b9-dee1-4180-8c78-a15fca61afa3 service nova] Acquiring lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:52:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-14e5e4c7-14f8-4e98-9aac-032c9e9510fb req-4490e6b9-dee1-4180-8c78-a15fca61afa3 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:52:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-14e5e4c7-14f8-4e98-9aac-032c9e9510fb req-4490e6b9-dee1-4180-8c78-a15fca61afa3 service nova] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-14e5e4c7-14f8-4e98-9aac-032c9e9510fb req-4490e6b9-dee1-4180-8c78-a15fca61afa3 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] No waiting events found dispatching network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:52:41 user nova-compute[75239]: WARNING nova.compute.manager [req-14e5e4c7-14f8-4e98-9aac-032c9e9510fb req-4490e6b9-dee1-4180-8c78-a15fca61afa3 service nova] [instance: 3cbf6e73-bc09-4e1f-b249-261f0534c6e0] Received unexpected event network-vif-plugged-480fb2da-ad24-40ae-8586-d9050eca6899 for instance with vm_state deleted and task_state None.
Nov 13 20:52:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d4b67fbe-0329-453f-b692-4da8a2fb67e0 tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "3cbf6e73-bc09-4e1f-b249-261f0534c6e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:52:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:52:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:52:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 20:52:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:52:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:52:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:53:03 user nova-compute[75239]: INFO nova.compute.claims [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Claim successful on node user
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.network.neutron [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:53:03 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:53:03 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Creating image(s)
Nov 13 20:53:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "/opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "/opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "/opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG nova.policy [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '71fa4b3479ba45158ec53220f0a50e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6332c7b10e4ed6a36361561148126d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.203s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk 1073741824" returned: 0 in 0.053s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.189s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Cannot resize image /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Ensure instance console log exists: /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:04 user nova-compute[75239]: DEBUG nova.network.neutron [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Successfully created port: ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Successfully updated port: ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquired lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-00e9e5c4-cc98-4a9b-a471-4fee27fa635d req-765516ce-d8a0-422c-a576-90447382cedb service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received event network-changed-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-00e9e5c4-cc98-4a9b-a471-4fee27fa635d req-765516ce-d8a0-422c-a576-90447382cedb service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Refreshing instance network info cache due to event network-changed-ca3b5551-7790-4f29-8f1c-17049e46bc86. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-00e9e5c4-cc98-4a9b-a471-4fee27fa635d req-765516ce-d8a0-422c-a576-90447382cedb service nova] Acquiring lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updating instance_info_cache with network_info: [{"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Releasing lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Instance network_info: |[{"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-00e9e5c4-cc98-4a9b-a471-4fee27fa635d req-765516ce-d8a0-422c-a576-90447382cedb service nova] Acquired lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.network.neutron [req-00e9e5c4-cc98-4a9b-a471-4fee27fa635d req-765516ce-d8a0-422c-a576-90447382cedb service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Refreshing network info cache for port ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Start _get_guest_xml network_info=[{"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:53:05 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:53:05 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:53:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-250984596',display_name='tempest-TestServerVolumeAttachmentScenario-server-250984596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-250984596',id=40,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwy2KCSb3PNgaN5P9BXGlu9+iiJRQ8cMcJzSp3IgJiS4RRfgZdSJVjdmmabN4lqDjkpJDHRsxSD/aWJXhxpybIbkzJgP2ju6nYpLhY2N/ddTqtmfXTlOamAFdHMdPA2+w==',key_name='tempest-keypair-1634108910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c6332c7b10e4ed6a36361561148126d',ramdisk_id='',reservation_id='r-u48s49ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-643324277',owner_user_name='tempest-TestServerVolumeAttachmentScenario-643324277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71fa4b3479ba45158ec53220f0a50e82',uuid=b585521b-0f65-4358-9830-a971e75a8705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Converting VIF {"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=ca3b5551-7790-4f29-8f1c-17049e46bc86,network=Network(e5be7fbe-0a70-4093-b236-82274eb248eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3b5551-77') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.objects.instance [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lazy-loading 'pci_devices' on Instance uuid b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:53:06 user nova-compute[75239]:   <uuid>b585521b-0f65-4358-9830-a971e75a8705</uuid>
Nov 13 20:53:06 user nova-compute[75239]:   <name>instance-00000028</name>
Nov 13 20:53:06 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:53:06 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:53:06 user nova-compute[75239]:   <metadata>
Nov 13 20:53:06 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:53:06 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:53:06 user nova-compute[75239]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-250984596</nova:name>
Nov 13 20:53:06 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:53:05</nova:creationTime>
Nov 13 20:53:06 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:53:06 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:53:06 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:53:06 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:53:06 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:53:06 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:53:06 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:53:06 user nova-compute[75239]:       <nova:owner>
Nov 13 20:53:06 user nova-compute[75239]:         <nova:user uuid="71fa4b3479ba45158ec53220f0a50e82">tempest-TestServerVolumeAttachmentScenario-643324277-project-member</nova:user>
Nov 13 20:53:06 user nova-compute[75239]:         <nova:project uuid="6c6332c7b10e4ed6a36361561148126d">tempest-TestServerVolumeAttachmentScenario-643324277</nova:project>
Nov 13 20:53:06 user nova-compute[75239]:       </nova:owner>
Nov 13 20:53:06 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:53:06 user nova-compute[75239]:       <nova:ports>
Nov 13 20:53:06 user nova-compute[75239]:         <nova:port uuid="ca3b5551-7790-4f29-8f1c-17049e46bc86">
Nov 13 20:53:06 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:53:06 user nova-compute[75239]:         </nova:port>
Nov 13 20:53:06 user nova-compute[75239]:       </nova:ports>
Nov 13 20:53:06 user nova-compute[75239]:     </nova:instance>
Nov 13 20:53:06 user nova-compute[75239]:   </metadata>
Nov 13 20:53:06 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:53:06 user nova-compute[75239]:     <system>
Nov 13 20:53:06 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:53:06 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:53:06 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:53:06 user nova-compute[75239]:       <entry name="serial">b585521b-0f65-4358-9830-a971e75a8705</entry>
Nov 13 20:53:06 user nova-compute[75239]:       <entry name="uuid">b585521b-0f65-4358-9830-a971e75a8705</entry>
Nov 13 20:53:06 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:53:06 user nova-compute[75239]:     </system>
Nov 13 20:53:06 user nova-compute[75239]:   </sysinfo>
Nov 13 20:53:06 user nova-compute[75239]:   <os>
Nov 13 20:53:06 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:53:06 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:53:06 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:53:06 user nova-compute[75239]:   </os>
Nov 13 20:53:06 user nova-compute[75239]:   <features>
Nov 13 20:53:06 user nova-compute[75239]:     <acpi/>
Nov 13 20:53:06 user nova-compute[75239]:     <apic/>
Nov 13 20:53:06 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:53:06 user nova-compute[75239]:   </features>
Nov 13 20:53:06 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:53:06 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:53:06 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:53:06 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:53:06 user nova-compute[75239]:   </clock>
Nov 13 20:53:06 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:53:06 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:53:06 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:53:06 user nova-compute[75239]:   </cpu>
Nov 13 20:53:06 user nova-compute[75239]:   <devices>
Nov 13 20:53:06 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:53:06 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:53:06 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk"/>
Nov 13 20:53:06 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:53:06 user nova-compute[75239]:     </disk>
Nov 13 20:53:06 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:53:06 user nova-compute[75239]:       <mac address="fa:16:3e:6b:ca:c0"/>
Nov 13 20:53:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:53:06 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:53:06 user nova-compute[75239]:       <target dev="tapca3b5551-77"/>
Nov 13 20:53:06 user nova-compute[75239]:     </interface>
Nov 13 20:53:06 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:53:06 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/console.log" append="off"/>
Nov 13 20:53:06 user nova-compute[75239]:     </serial>
Nov 13 20:53:06 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:53:06 user nova-compute[75239]:     <video>
Nov 13 20:53:06 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:53:06 user nova-compute[75239]:     </video>
Nov 13 20:53:06 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:53:06 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:53:06 user nova-compute[75239]:     </rng>
Nov 13 20:53:06 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:53:06 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:53:06 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:53:06 user nova-compute[75239]:     </memballoon>
Nov 13 20:53:06 user nova-compute[75239]:   </devices>
Nov 13 20:53:06 user nova-compute[75239]: </domain>
Nov 13 20:53:06 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-250984596',display_name='tempest-TestServerVolumeAttachmentScenario-server-250984596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-250984596',id=40,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwy2KCSb3PNgaN5P9BXGlu9+iiJRQ8cMcJzSp3IgJiS4RRfgZdSJVjdmmabN4lqDjkpJDHRsxSD/aWJXhxpybIbkzJgP2ju6nYpLhY2N/ddTqtmfXTlOamAFdHMdPA2+w==',key_name='tempest-keypair-1634108910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c6332c7b10e4ed6a36361561148126d',ramdisk_id='',reservation_id='r-u48s49ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-643324277',owner_user_name='tempest-TestServerVolumeAttachmentScenario-643324277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:53:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71fa4b3479ba45158ec53220f0a50e82',uuid=b585521b-0f65-4358-9830-a971e75a8705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Converting VIF {"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=ca3b5551-7790-4f29-8f1c-17049e46bc86,network=Network(e5be7fbe-0a70-4093-b236-82274eb248eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3b5551-77') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG os_vif [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=ca3b5551-7790-4f29-8f1c-17049e46bc86,network=Network(e5be7fbe-0a70-4093-b236-82274eb248eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3b5551-77') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '407d94c8-133d-597a-af8c-32bb5ced4f72', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca3b5551-77, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca3b5551-77, col_values=(('qos', UUID('dc849a8a-1652-4cc3-bb66-61e9b1a7c0e7')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca3b5551-77, col_values=(('external_ids', {'iface-id': 'ca3b5551-7790-4f29-8f1c-17049e46bc86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:ca:c0', 'vm-uuid': 'b585521b-0f65-4358-9830-a971e75a8705'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:06 user nova-compute[75239]: INFO os_vif [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=ca3b5551-7790-4f29-8f1c-17049e46bc86,network=Network(e5be7fbe-0a70-4093-b236-82274eb248eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3b5551-77')
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] No VIF found with MAC fa:16:3e:6b:ca:c0, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.network.neutron [req-00e9e5c4-cc98-4a9b-a471-4fee27fa635d req-765516ce-d8a0-422c-a576-90447382cedb service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updated VIF entry in instance network info cache for port ca3b5551-7790-4f29-8f1c-17049e46bc86. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG nova.network.neutron [req-00e9e5c4-cc98-4a9b-a471-4fee27fa635d req-765516ce-d8a0-422c-a576-90447382cedb service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updating instance_info_cache with network_info: [{"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-00e9e5c4-cc98-4a9b-a471-4fee27fa635d req-765516ce-d8a0-422c-a576-90447382cedb service nova] Releasing lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:53:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-608ae74e-2f33-44cc-9565-7fce732590c2 req-e5ec9139-69ef-439e-8e63-3477fadd9192 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received event network-vif-plugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-608ae74e-2f33-44cc-9565-7fce732590c2 req-e5ec9139-69ef-439e-8e63-3477fadd9192 service nova] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-608ae74e-2f33-44cc-9565-7fce732590c2 req-e5ec9139-69ef-439e-8e63-3477fadd9192 service nova] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-608ae74e-2f33-44cc-9565-7fce732590c2 req-e5ec9139-69ef-439e-8e63-3477fadd9192 service nova] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-608ae74e-2f33-44cc-9565-7fce732590c2 req-e5ec9139-69ef-439e-8e63-3477fadd9192 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] No waiting events found dispatching network-vif-plugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:07 user nova-compute[75239]: WARNING nova.compute.manager [req-608ae74e-2f33-44cc-9565-7fce732590c2 req-e5ec9139-69ef-439e-8e63-3477fadd9192 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received unexpected event network-vif-plugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 for instance with vm_state building and task_state spawning.
Nov 13 20:53:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:53:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: b585521b-0f65-4358-9830-a971e75a8705] Instance spawned successfully.
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-ecbf7c3f-3a0d-4d58-bc5e-5caedd5fcae5 req-7cecd9db-b12a-4133-a35f-907288ee8184 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received event network-vif-plugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ecbf7c3f-3a0d-4d58-bc5e-5caedd5fcae5 req-7cecd9db-b12a-4133-a35f-907288ee8184 service nova] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ecbf7c3f-3a0d-4d58-bc5e-5caedd5fcae5 req-7cecd9db-b12a-4133-a35f-907288ee8184 service nova] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ecbf7c3f-3a0d-4d58-bc5e-5caedd5fcae5 req-7cecd9db-b12a-4133-a35f-907288ee8184 service nova] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-ecbf7c3f-3a0d-4d58-bc5e-5caedd5fcae5 req-7cecd9db-b12a-4133-a35f-907288ee8184 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] No waiting events found dispatching network-vif-plugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:09 user nova-compute[75239]: WARNING nova.compute.manager [req-ecbf7c3f-3a0d-4d58-bc5e-5caedd5fcae5 req-7cecd9db-b12a-4133-a35f-907288ee8184 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received unexpected event network-vif-plugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 for instance with vm_state building and task_state spawning.
Nov 13 20:53:09 user nova-compute[75239]: INFO nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 13 20:53:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:53:10 user nova-compute[75239]: INFO nova.compute.manager [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Took 6.58 seconds to build instance.
Nov 13 20:53:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-71cdcbd4-4ae1-44e6-b655-fe82ae44ad03 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.687s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:29 user nova-compute[75239]: INFO nova.compute.manager [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Terminating instance
Nov 13 20:53:29 user nova-compute[75239]: DEBUG nova.compute.manager [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:53:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-f90565c4-5e79-4441-bf4c-85a014b3b7b4 req-bf9df4b5-d436-4605-90d2-6b5f31339b60 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-unplugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f90565c4-5e79-4441-bf4c-85a014b3b7b4 req-bf9df4b5-d436-4605-90d2-6b5f31339b60 service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f90565c4-5e79-4441-bf4c-85a014b3b7b4 req-bf9df4b5-d436-4605-90d2-6b5f31339b60 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f90565c4-5e79-4441-bf4c-85a014b3b7b4 req-bf9df4b5-d436-4605-90d2-6b5f31339b60 service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-f90565c4-5e79-4441-bf4c-85a014b3b7b4 req-bf9df4b5-d436-4605-90d2-6b5f31339b60 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-unplugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-f90565c4-5e79-4441-bf4c-85a014b3b7b4 req-bf9df4b5-d436-4605-90d2-6b5f31339b60 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-unplugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Instance destroyed successfully.
Nov 13 20:53:30 user nova-compute[75239]: DEBUG nova.objects.instance [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lazy-loading 'resources' on Instance uuid 4ca1da31-616b-4f78-b50b-6e58d8d70974 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-760259817',display_name='tempest-ServerRescueNegativeTestJSON-server-760259817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-760259817',id=17,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='41532512e3494bfd9051c340c2557bfe',ramdisk_id='',reservation_id='r-n3bmobey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1212200086',owner_user_name='tempest-ServerRescueNegativeTestJSON-1212200086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:43:25Z,user_data=None,user_id='b27083a4000d4ba2832a394b9140b530',uuid=4ca1da31-616b-4f78-b50b-6e58d8d70974,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converting VIF {"id": "b2ae89b4-c188-415f-96da-bb22e699bc22", "address": "fa:16:3e:1b:ec:16", "network": {"id": "a08a640a-c52f-4c18-a7e6-a6cae391d7ae", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-518809401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "41532512e3494bfd9051c340c2557bfe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2ae89b4-c1", "ovs_interfaceid": "b2ae89b4-c188-415f-96da-bb22e699bc22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=b2ae89b4-c188-415f-96da-bb22e699bc22,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ae89b4-c1') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG os_vif [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=b2ae89b4-c188-415f-96da-bb22e699bc22,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ae89b4-c1') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2ae89b4-c1, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dc73691-a869-4acf-b3cd-6c0d1471ac5d) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:53:30 user nova-compute[75239]: INFO os_vif [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ec:16,bridge_name='br-int',has_traffic_filtering=True,id=b2ae89b4-c188-415f-96da-bb22e699bc22,network=Network(a08a640a-c52f-4c18-a7e6-a6cae391d7ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2ae89b4-c1')
Nov 13 20:53:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Deleting instance files /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974_del
Nov 13 20:53:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Deletion of /opt/stack/data/nova/instances/4ca1da31-616b-4f78-b50b-6e58d8d70974_del complete
Nov 13 20:53:30 user nova-compute[75239]: INFO nova.compute.manager [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 13 20:53:30 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:53:30 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:53:31 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:31 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Took 0.60 seconds to deallocate network for instance.
Nov 13 20:53:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-0daa2c82-af5d-4457-a082-5e854115ca60 req-c3d42a7f-39bf-491a-8a29-c59c014e9ef7 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-deleted-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:31 user nova-compute[75239]: INFO nova.compute.manager [req-0daa2c82-af5d-4457-a082-5e854115ca60 req-c3d42a7f-39bf-491a-8a29-c59c014e9ef7 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Neutron deleted interface b2ae89b4-c188-415f-96da-bb22e699bc22; detaching it from the instance and deleting it from the info cache
Nov 13 20:53:31 user nova-compute[75239]: DEBUG nova.network.neutron [req-0daa2c82-af5d-4457-a082-5e854115ca60 req-c3d42a7f-39bf-491a-8a29-c59c014e9ef7 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:31 user nova-compute[75239]: DEBUG nova.compute.manager [req-0daa2c82-af5d-4457-a082-5e854115ca60 req-c3d42a7f-39bf-491a-8a29-c59c014e9ef7 service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Detach interface failed, port_id=b2ae89b4-c188-415f-96da-bb22e699bc22, reason: Instance 4ca1da31-616b-4f78-b50b-6e58d8d70974 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:53:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:31 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:53:31 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:53:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:31 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Deleted allocations for instance 4ca1da31-616b-4f78-b50b-6e58d8d70974
Nov 13 20:53:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-3cca6620-3ccd-4611-9b75-c1053d0c462e tempest-ServerRescueNegativeTestJSON-1212200086 tempest-ServerRescueNegativeTestJSON-1212200086-project-member] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-e11a4acc-3d88-41cc-9d43-a83ee945ef01 req-2373bb1d-a470-4f14-8dca-16ef603cc04f service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e11a4acc-3d88-41cc-9d43-a83ee945ef01 req-2373bb1d-a470-4f14-8dca-16ef603cc04f service nova] Acquiring lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e11a4acc-3d88-41cc-9d43-a83ee945ef01 req-2373bb1d-a470-4f14-8dca-16ef603cc04f service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e11a4acc-3d88-41cc-9d43-a83ee945ef01 req-2373bb1d-a470-4f14-8dca-16ef603cc04f service nova] Lock "4ca1da31-616b-4f78-b50b-6e58d8d70974-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:32 user nova-compute[75239]: DEBUG nova.compute.manager [req-e11a4acc-3d88-41cc-9d43-a83ee945ef01 req-2373bb1d-a470-4f14-8dca-16ef603cc04f service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] No waiting events found dispatching network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:32 user nova-compute[75239]: WARNING nova.compute.manager [req-e11a4acc-3d88-41cc-9d43-a83ee945ef01 req-2373bb1d-a470-4f14-8dca-16ef603cc04f service nova] [instance: 4ca1da31-616b-4f78-b50b-6e58d8d70974] Received unexpected event network-vif-plugged-b2ae89b4-c188-415f-96da-bb22e699bc22 for instance with vm_state deleted and task_state None.
Nov 13 20:53:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-94d1f0c7-8483-4988-956d-28cb9f1b9154 req-a59d77f3-6904-4c3a-ad1c-d65d24d0dc0e service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-changed-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG nova.compute.manager [req-94d1f0c7-8483-4988-956d-28cb9f1b9154 req-a59d77f3-6904-4c3a-ad1c-d65d24d0dc0e service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Refreshing instance network info cache due to event network-changed-26dcf975-7fd9-4712-8c74-625273620527. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-94d1f0c7-8483-4988-956d-28cb9f1b9154 req-a59d77f3-6904-4c3a-ad1c-d65d24d0dc0e service nova] Acquiring lock "refresh_cache-d05a4121-e321-432a-9f25-605ad901efdd" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-94d1f0c7-8483-4988-956d-28cb9f1b9154 req-a59d77f3-6904-4c3a-ad1c-d65d24d0dc0e service nova] Acquired lock "refresh_cache-d05a4121-e321-432a-9f25-605ad901efdd" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG nova.network.neutron [req-94d1f0c7-8483-4988-956d-28cb9f1b9154 req-a59d77f3-6904-4c3a-ad1c-d65d24d0dc0e service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Refreshing network info cache for port 26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG nova.network.neutron [req-94d1f0c7-8483-4988-956d-28cb9f1b9154 req-a59d77f3-6904-4c3a-ad1c-d65d24d0dc0e service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Updated VIF entry in instance network info cache for port 26dcf975-7fd9-4712-8c74-625273620527. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG nova.network.neutron [req-94d1f0c7-8483-4988-956d-28cb9f1b9154 req-a59d77f3-6904-4c3a-ad1c-d65d24d0dc0e service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Updating instance_info_cache with network_info: [{"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "d05a4121-e321-432a-9f25-605ad901efdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:33 user nova-compute[75239]: INFO nova.compute.manager [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Terminating instance
Nov 13 20:53:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-94d1f0c7-8483-4988-956d-28cb9f1b9154 req-a59d77f3-6904-4c3a-ad1c-d65d24d0dc0e service nova] Releasing lock "refresh_cache-d05a4121-e321-432a-9f25-605ad901efdd" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Instance destroyed successfully.
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.objects.instance [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'resources' on Instance uuid d05a4121-e321-432a-9f25-605ad901efdd {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:51:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1715884895',display_name='tempest-AttachVolumeNegativeTest-server-1715884895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1715884895',id=38,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAW+TS9Id+FRGZR+s1PgLasaKlS1yZqd/+YwqsE9WJ8s9av/6rP87zwQSXwxe85SjPjb75w+e937v/6dmFqcN93kLROZ+sx0zDGtyVL+58SsiKfy84ZhegISL4svdYkpeg==',key_name='tempest-keypair-634537538',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:51:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-0iw7h0uu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=d05a4121-e321-432a-9f25-605ad901efdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "26dcf975-7fd9-4712-8c74-625273620527", "address": "fa:16:3e:ff:4b:37", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dcf975-7f", "ovs_interfaceid": "26dcf975-7fd9-4712-8c74-625273620527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4b:37,bridge_name='br-int',has_traffic_filtering=True,id=26dcf975-7fd9-4712-8c74-625273620527,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dcf975-7f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG os_vif [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4b:37,bridge_name='br-int',has_traffic_filtering=True,id=26dcf975-7fd9-4712-8c74-625273620527,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dcf975-7f') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26dcf975-7f, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e97f6f74-97ca-4890-be0b-9520f46507e0) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:53:34 user nova-compute[75239]: INFO os_vif [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:4b:37,bridge_name='br-int',has_traffic_filtering=True,id=26dcf975-7fd9-4712-8c74-625273620527,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dcf975-7f')
Nov 13 20:53:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Deleting instance files /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd_del
Nov 13 20:53:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Deletion of /opt/stack/data/nova/instances/d05a4121-e321-432a-9f25-605ad901efdd_del complete
Nov 13 20:53:34 user nova-compute[75239]: INFO nova.compute.manager [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 13 20:53:34 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: d05a4121-e321-432a-9f25-605ad901efdd] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.compute.manager [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-unplugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.compute.manager [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] No waiting events found dispatching network-vif-unplugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.compute.manager [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-unplugged-26dcf975-7fd9-4712-8c74-625273620527 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.compute.manager [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG nova.compute.manager [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] No waiting events found dispatching network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:34 user nova-compute[75239]: WARNING nova.compute.manager [req-901c3e8d-1b4d-467d-bc1d-d74fef0b7366 req-97e58cda-3401-4524-9c58-d3a1f3ccbc5d service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received unexpected event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 for instance with vm_state active and task_state deleting.
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:35 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:35 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Took 0.75 seconds to deallocate network for instance.
Nov 13 20:53:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-7450284f-bf80-47ae-87ee-2074c93d9c9e req-f81ee588-fb8a-407a-8c55-92ee7b1229f9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-deleted-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:35 user nova-compute[75239]: INFO nova.compute.manager [req-7450284f-bf80-47ae-87ee-2074c93d9c9e req-f81ee588-fb8a-407a-8c55-92ee7b1229f9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Neutron deleted interface 26dcf975-7fd9-4712-8c74-625273620527; detaching it from the instance and deleting it from the info cache
Nov 13 20:53:35 user nova-compute[75239]: DEBUG nova.network.neutron [req-7450284f-bf80-47ae-87ee-2074c93d9c9e req-f81ee588-fb8a-407a-8c55-92ee7b1229f9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-7450284f-bf80-47ae-87ee-2074c93d9c9e req-f81ee588-fb8a-407a-8c55-92ee7b1229f9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Detach interface failed, port_id=26dcf975-7fd9-4712-8c74-625273620527, reason: Instance d05a4121-e321-432a-9f25-605ad901efdd could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:53:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:35 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:53:35 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:53:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:35 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Deleted allocations for instance d05a4121-e321-432a-9f25-605ad901efdd
Nov 13 20:53:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-165fd57f-2b3a-4f62-a554-06a3e92b59de tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "d05a4121-e321-432a-9f25-605ad901efdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] No waiting events found dispatching network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:36 user nova-compute[75239]: WARNING nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received unexpected event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 for instance with vm_state deleted and task_state None.
Nov 13 20:53:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] No waiting events found dispatching network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:36 user nova-compute[75239]: WARNING nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received unexpected event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 for instance with vm_state deleted and task_state None.
Nov 13 20:53:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-unplugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] No waiting events found dispatching network-vif-unplugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:36 user nova-compute[75239]: WARNING nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received unexpected event network-vif-unplugged-26dcf975-7fd9-4712-8c74-625273620527 for instance with vm_state deleted and task_state None.
Nov 13 20:53:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Acquiring lock "d05a4121-e321-432a-9f25-605ad901efdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] Lock "d05a4121-e321-432a-9f25-605ad901efdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:36 user nova-compute[75239]: DEBUG nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] No waiting events found dispatching network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:36 user nova-compute[75239]: WARNING nova.compute.manager [req-5dcc0709-0ee6-49ad-930a-10a62da9644a req-4c0fd318-b26d-48dc-9bda-406d38f772e9 service nova] [instance: d05a4121-e321-432a-9f25-605ad901efdd] Received unexpected event network-vif-plugged-26dcf975-7fd9-4712-8c74-625273620527 for instance with vm_state deleted and task_state None.
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:53:39 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:53:39 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:53:39 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8487MB free_disk=24.982593536376953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:53:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c0591fd1-adfd-4626-806a-a71f46c80400 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance b585521b-0f65-4358-9830-a971e75a8705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 20:53:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 20:53:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:53:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 20:53:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:48 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 4db9d6bf-a3f0-4495-af7c-272e74e34324 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Updating instance_info_cache with network_info: [{"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-4db9d6bf-a3f0-4495-af7c-272e74e34324" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:53:49 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:53:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:50 user nova-compute[75239]: DEBUG nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:53:51 user nova-compute[75239]: INFO nova.compute.claims [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Claim successful on node user
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.network.neutron [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:53:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.policy [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6bc1e54d23824501a21398dd0410bba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c29838280436f85a2242f1c344eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:53:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Creating image(s)
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "/opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "/opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "/opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk 1073741824" returned: 0 in 0.049s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Cannot resize image /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Ensure instance console log exists: /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:52 user nova-compute[75239]: DEBUG nova.network.neutron [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Successfully created port: 3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Successfully updated port: 3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "refresh_cache-82cbd069-61e0-4858-83e8-29c90791bbed" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquired lock "refresh_cache-82cbd069-61e0-4858-83e8-29c90791bbed" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.compute.manager [req-cded09ef-8de2-44b8-ab85-9215443ba84f req-f59c8f15-58a4-4669-985d-dfe4c8c6a14e service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received event network-changed-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.compute.manager [req-cded09ef-8de2-44b8-ab85-9215443ba84f req-f59c8f15-58a4-4669-985d-dfe4c8c6a14e service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Refreshing instance network info cache due to event network-changed-3c261642-c8a9-4e66-91f6-6882d6f8a04f. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cded09ef-8de2-44b8-ab85-9215443ba84f req-f59c8f15-58a4-4669-985d-dfe4c8c6a14e service nova] Acquiring lock "refresh_cache-82cbd069-61e0-4858-83e8-29c90791bbed" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Updating instance_info_cache with network_info: [{"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Releasing lock "refresh_cache-82cbd069-61e0-4858-83e8-29c90791bbed" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Instance network_info: |[{"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cded09ef-8de2-44b8-ab85-9215443ba84f req-f59c8f15-58a4-4669-985d-dfe4c8c6a14e service nova] Acquired lock "refresh_cache-82cbd069-61e0-4858-83e8-29c90791bbed" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.neutron [req-cded09ef-8de2-44b8-ab85-9215443ba84f req-f59c8f15-58a4-4669-985d-dfe4c8c6a14e service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Refreshing network info cache for port 3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Start _get_guest_xml network_info=[{"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:53:53 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:53:53 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:53:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1838686943',display_name='tempest-VolumesSnapshotTestJSON-instance-1838686943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1838686943',id=41,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVrmDkMNMyU4DUUGd7beJONQQQA6ghoybiPjGw4ZbPGvf1yif3CII3RQhk/D016f4rR7fSOL+WoLoj3r6VkZzUyWztw7JaGjCnM5hW20r9oYjo1llwaWRxqg4R089DDRw==',key_name='tempest-keypair-1410843722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909c29838280436f85a2242f1c344eef',ramdisk_id='',reservation_id='r-n1i8pzs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-77894400',owner_user_name='tempest-VolumesSnapshotTestJSON-77894400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bc1e54d23824501a21398dd0410bba1',uuid=82cbd069-61e0-4858-83e8-29c90791bbed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converting VIF {"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c261642-c8a9-4e66-91f6-6882d6f8a04f,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c261642-c8') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.objects.instance [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'pci_devices' on Instance uuid 82cbd069-61e0-4858-83e8-29c90791bbed {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:53:53 user nova-compute[75239]:   <uuid>82cbd069-61e0-4858-83e8-29c90791bbed</uuid>
Nov 13 20:53:53 user nova-compute[75239]:   <name>instance-00000029</name>
Nov 13 20:53:53 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:53:53 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:53:53 user nova-compute[75239]:   <metadata>
Nov 13 20:53:53 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:53:53 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:53:53 user nova-compute[75239]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1838686943</nova:name>
Nov 13 20:53:53 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:53:53</nova:creationTime>
Nov 13 20:53:53 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:53:53 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:53:53 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:53:53 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:53:53 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:53:53 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:53:53 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:53:53 user nova-compute[75239]:       <nova:owner>
Nov 13 20:53:53 user nova-compute[75239]:         <nova:user uuid="6bc1e54d23824501a21398dd0410bba1">tempest-VolumesSnapshotTestJSON-77894400-project-member</nova:user>
Nov 13 20:53:53 user nova-compute[75239]:         <nova:project uuid="909c29838280436f85a2242f1c344eef">tempest-VolumesSnapshotTestJSON-77894400</nova:project>
Nov 13 20:53:53 user nova-compute[75239]:       </nova:owner>
Nov 13 20:53:53 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:53:53 user nova-compute[75239]:       <nova:ports>
Nov 13 20:53:53 user nova-compute[75239]:         <nova:port uuid="3c261642-c8a9-4e66-91f6-6882d6f8a04f">
Nov 13 20:53:53 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 20:53:53 user nova-compute[75239]:         </nova:port>
Nov 13 20:53:53 user nova-compute[75239]:       </nova:ports>
Nov 13 20:53:53 user nova-compute[75239]:     </nova:instance>
Nov 13 20:53:53 user nova-compute[75239]:   </metadata>
Nov 13 20:53:53 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:53:53 user nova-compute[75239]:     <system>
Nov 13 20:53:53 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:53:53 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:53:53 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:53:53 user nova-compute[75239]:       <entry name="serial">82cbd069-61e0-4858-83e8-29c90791bbed</entry>
Nov 13 20:53:53 user nova-compute[75239]:       <entry name="uuid">82cbd069-61e0-4858-83e8-29c90791bbed</entry>
Nov 13 20:53:53 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:53:53 user nova-compute[75239]:     </system>
Nov 13 20:53:53 user nova-compute[75239]:   </sysinfo>
Nov 13 20:53:53 user nova-compute[75239]:   <os>
Nov 13 20:53:53 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:53:53 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:53:53 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:53:53 user nova-compute[75239]:   </os>
Nov 13 20:53:53 user nova-compute[75239]:   <features>
Nov 13 20:53:53 user nova-compute[75239]:     <acpi/>
Nov 13 20:53:53 user nova-compute[75239]:     <apic/>
Nov 13 20:53:53 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:53:53 user nova-compute[75239]:   </features>
Nov 13 20:53:53 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:53:53 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:53:53 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:53:53 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:53:53 user nova-compute[75239]:   </clock>
Nov 13 20:53:53 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:53:53 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:53:53 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:53:53 user nova-compute[75239]:   </cpu>
Nov 13 20:53:53 user nova-compute[75239]:   <devices>
Nov 13 20:53:53 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:53:53 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:53:53 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk"/>
Nov 13 20:53:53 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:53:53 user nova-compute[75239]:     </disk>
Nov 13 20:53:53 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:53:53 user nova-compute[75239]:       <mac address="fa:16:3e:c7:92:7c"/>
Nov 13 20:53:53 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:53:53 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:53:53 user nova-compute[75239]:       <target dev="tap3c261642-c8"/>
Nov 13 20:53:53 user nova-compute[75239]:     </interface>
Nov 13 20:53:53 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:53:53 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/console.log" append="off"/>
Nov 13 20:53:53 user nova-compute[75239]:     </serial>
Nov 13 20:53:53 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:53:53 user nova-compute[75239]:     <video>
Nov 13 20:53:53 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:53:53 user nova-compute[75239]:     </video>
Nov 13 20:53:53 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:53:53 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:53:53 user nova-compute[75239]:     </rng>
Nov 13 20:53:53 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:53:53 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:53:53 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:53:53 user nova-compute[75239]:     </memballoon>
Nov 13 20:53:53 user nova-compute[75239]:   </devices>
Nov 13 20:53:53 user nova-compute[75239]: </domain>
Nov 13 20:53:53 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:53:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1838686943',display_name='tempest-VolumesSnapshotTestJSON-instance-1838686943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1838686943',id=41,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVrmDkMNMyU4DUUGd7beJONQQQA6ghoybiPjGw4ZbPGvf1yif3CII3RQhk/D016f4rR7fSOL+WoLoj3r6VkZzUyWztw7JaGjCnM5hW20r9oYjo1llwaWRxqg4R089DDRw==',key_name='tempest-keypair-1410843722',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909c29838280436f85a2242f1c344eef',ramdisk_id='',reservation_id='r-n1i8pzs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-77894400',owner_user_name='tempest-VolumesSnapshotTestJSON-77894400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:53:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bc1e54d23824501a21398dd0410bba1',uuid=82cbd069-61e0-4858-83e8-29c90791bbed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converting VIF {"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c261642-c8a9-4e66-91f6-6882d6f8a04f,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c261642-c8') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG os_vif [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c261642-c8a9-4e66-91f6-6882d6f8a04f,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c261642-c8') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1800f71-e5a3-5dbc-bc27-0b0662489147', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c261642-c8, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c261642-c8, col_values=(('qos', UUID('4e8bdd6c-f863-46da-8c4c-a4e921b8681d')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c261642-c8, col_values=(('external_ids', {'iface-id': '3c261642-c8a9-4e66-91f6-6882d6f8a04f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:92:7c', 'vm-uuid': '82cbd069-61e0-4858-83e8-29c90791bbed'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:53 user nova-compute[75239]: INFO os_vif [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c261642-c8a9-4e66-91f6-6882d6f8a04f,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c261642-c8')
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No VIF found with MAC fa:16:3e:c7:92:7c, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.neutron [req-cded09ef-8de2-44b8-ab85-9215443ba84f req-f59c8f15-58a4-4669-985d-dfe4c8c6a14e service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Updated VIF entry in instance network info cache for port 3c261642-c8a9-4e66-91f6-6882d6f8a04f. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG nova.network.neutron [req-cded09ef-8de2-44b8-ab85-9215443ba84f req-f59c8f15-58a4-4669-985d-dfe4c8c6a14e service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Updating instance_info_cache with network_info: [{"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:53:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-cded09ef-8de2-44b8-ab85-9215443ba84f req-f59c8f15-58a4-4669-985d-dfe4c8c6a14e service nova] Releasing lock "refresh_cache-82cbd069-61e0-4858-83e8-29c90791bbed" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:53:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-2eaf16f0-d661-4e4f-84bd-3d8148defbb5 req-c85e1390-532b-4fc7-8dfa-fad1ffa7e642 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received event network-vif-plugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2eaf16f0-d661-4e4f-84bd-3d8148defbb5 req-c85e1390-532b-4fc7-8dfa-fad1ffa7e642 service nova] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2eaf16f0-d661-4e4f-84bd-3d8148defbb5 req-c85e1390-532b-4fc7-8dfa-fad1ffa7e642 service nova] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2eaf16f0-d661-4e4f-84bd-3d8148defbb5 req-c85e1390-532b-4fc7-8dfa-fad1ffa7e642 service nova] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-2eaf16f0-d661-4e4f-84bd-3d8148defbb5 req-c85e1390-532b-4fc7-8dfa-fad1ffa7e642 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] No waiting events found dispatching network-vif-plugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:55 user nova-compute[75239]: WARNING nova.compute.manager [req-2eaf16f0-d661-4e4f-84bd-3d8148defbb5 req-c85e1390-532b-4fc7-8dfa-fad1ffa7e642 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received unexpected event network-vif-plugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f for instance with vm_state building and task_state spawning.
Nov 13 20:53:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-b53b7da9-080a-46a3-9372-9cde41083a6c req-9e719bbd-f019-4b71-9d9b-9b54ad0ae64b service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received event network-vif-plugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b53b7da9-080a-46a3-9372-9cde41083a6c req-9e719bbd-f019-4b71-9d9b-9b54ad0ae64b service nova] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b53b7da9-080a-46a3-9372-9cde41083a6c req-9e719bbd-f019-4b71-9d9b-9b54ad0ae64b service nova] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b53b7da9-080a-46a3-9372-9cde41083a6c req-9e719bbd-f019-4b71-9d9b-9b54ad0ae64b service nova] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-b53b7da9-080a-46a3-9372-9cde41083a6c req-9e719bbd-f019-4b71-9d9b-9b54ad0ae64b service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] No waiting events found dispatching network-vif-plugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:53:57 user nova-compute[75239]: WARNING nova.compute.manager [req-b53b7da9-080a-46a3-9372-9cde41083a6c req-9e719bbd-f019-4b71-9d9b-9b54ad0ae64b service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received unexpected event network-vif-plugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f for instance with vm_state building and task_state spawning.
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:53:57 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Instance spawned successfully.
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:53:57 user nova-compute[75239]: INFO nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 13 20:53:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:53:57 user nova-compute[75239]: INFO nova.compute.manager [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Took 6.48 seconds to build instance.
Nov 13 20:53:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-85e9000f-0e92-40d5-8045-7436be0b74a1 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.581s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:53:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:53:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:54:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:54:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 20:54:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:54:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:54:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:54:18 user nova-compute[75239]: INFO nova.compute.claims [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Claim successful on node user
Nov 13 20:54:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:54:18 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:54:19 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:54:19 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG nova.policy [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e79a6935af1f47cebd04dcb0ec9e487e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '617b57945a52486a96a05958d9850e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:54:19 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Creating image(s)
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "/opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "/opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.240s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk 1073741824" returned: 0 in 0.057s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Successfully created port: feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.221s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:54:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Cannot resize image /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Ensure instance console log exists: /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Successfully updated port: feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "refresh_cache-6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquired lock "refresh_cache-6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-aa0e88f7-03c3-4355-a5e1-b36e67ec421b req-b0775b76-3037-4515-bce2-5b6293966f94 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received event network-changed-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-aa0e88f7-03c3-4355-a5e1-b36e67ec421b req-b0775b76-3037-4515-bce2-5b6293966f94 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Refreshing instance network info cache due to event network-changed-feab83fb-4c10-4bf3-97a2-557dc85567e9. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-aa0e88f7-03c3-4355-a5e1-b36e67ec421b req-b0775b76-3037-4515-bce2-5b6293966f94 service nova] Acquiring lock "refresh_cache-6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Updating instance_info_cache with network_info: [{"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Releasing lock "refresh_cache-6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Instance network_info: |[{"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-aa0e88f7-03c3-4355-a5e1-b36e67ec421b req-b0775b76-3037-4515-bce2-5b6293966f94 service nova] Acquired lock "refresh_cache-6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.network.neutron [req-aa0e88f7-03c3-4355-a5e1-b36e67ec421b req-b0775b76-3037-4515-bce2-5b6293966f94 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Refreshing network info cache for port feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Start _get_guest_xml network_info=[{"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:54:20 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:54:20 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1520121881',display_name='tempest-ServersNegativeTestJSON-server-1520121881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1520121881',id=42,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='617b57945a52486a96a05958d9850e06',ramdisk_id='',reservation_id='r-60jri1du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-462526943',owner_user_name='tempest-ServersNegativeTestJSON-462526943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:54:19Z,user_data=None,user_id='e79a6935af1f47cebd04dcb0ec9e487e',uuid=6f043e92-ecf4-48f2-b6a7-ce6b55e40b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converting VIF {"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fb:c3,bridge_name='br-int',has_traffic_filtering=True,id=feab83fb-4c10-4bf3-97a2-557dc85567e9,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeab83fb-4c') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.objects.instance [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:54:20 user nova-compute[75239]:   <uuid>6f043e92-ecf4-48f2-b6a7-ce6b55e40b27</uuid>
Nov 13 20:54:20 user nova-compute[75239]:   <name>instance-0000002a</name>
Nov 13 20:54:20 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:54:20 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:54:20 user nova-compute[75239]:   <metadata>
Nov 13 20:54:20 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:54:20 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:54:20 user nova-compute[75239]:       <nova:name>tempest-ServersNegativeTestJSON-server-1520121881</nova:name>
Nov 13 20:54:20 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:54:20</nova:creationTime>
Nov 13 20:54:20 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:54:20 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:54:20 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:54:20 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:54:20 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:54:20 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:54:20 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:54:20 user nova-compute[75239]:       <nova:owner>
Nov 13 20:54:20 user nova-compute[75239]:         <nova:user uuid="e79a6935af1f47cebd04dcb0ec9e487e">tempest-ServersNegativeTestJSON-462526943-project-member</nova:user>
Nov 13 20:54:20 user nova-compute[75239]:         <nova:project uuid="617b57945a52486a96a05958d9850e06">tempest-ServersNegativeTestJSON-462526943</nova:project>
Nov 13 20:54:20 user nova-compute[75239]:       </nova:owner>
Nov 13 20:54:20 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:54:20 user nova-compute[75239]:       <nova:ports>
Nov 13 20:54:20 user nova-compute[75239]:         <nova:port uuid="feab83fb-4c10-4bf3-97a2-557dc85567e9">
Nov 13 20:54:20 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 20:54:20 user nova-compute[75239]:         </nova:port>
Nov 13 20:54:20 user nova-compute[75239]:       </nova:ports>
Nov 13 20:54:20 user nova-compute[75239]:     </nova:instance>
Nov 13 20:54:20 user nova-compute[75239]:   </metadata>
Nov 13 20:54:20 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:54:20 user nova-compute[75239]:     <system>
Nov 13 20:54:20 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:54:20 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:54:20 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:54:20 user nova-compute[75239]:       <entry name="serial">6f043e92-ecf4-48f2-b6a7-ce6b55e40b27</entry>
Nov 13 20:54:20 user nova-compute[75239]:       <entry name="uuid">6f043e92-ecf4-48f2-b6a7-ce6b55e40b27</entry>
Nov 13 20:54:20 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:54:20 user nova-compute[75239]:     </system>
Nov 13 20:54:20 user nova-compute[75239]:   </sysinfo>
Nov 13 20:54:20 user nova-compute[75239]:   <os>
Nov 13 20:54:20 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:54:20 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:54:20 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:54:20 user nova-compute[75239]:   </os>
Nov 13 20:54:20 user nova-compute[75239]:   <features>
Nov 13 20:54:20 user nova-compute[75239]:     <acpi/>
Nov 13 20:54:20 user nova-compute[75239]:     <apic/>
Nov 13 20:54:20 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:54:20 user nova-compute[75239]:   </features>
Nov 13 20:54:20 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:54:20 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:54:20 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:54:20 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:54:20 user nova-compute[75239]:   </clock>
Nov 13 20:54:20 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:54:20 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:54:20 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:54:20 user nova-compute[75239]:   </cpu>
Nov 13 20:54:20 user nova-compute[75239]:   <devices>
Nov 13 20:54:20 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:54:20 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:54:20 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk"/>
Nov 13 20:54:20 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:54:20 user nova-compute[75239]:     </disk>
Nov 13 20:54:20 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:54:20 user nova-compute[75239]:       <mac address="fa:16:3e:4b:fb:c3"/>
Nov 13 20:54:20 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:54:20 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:54:20 user nova-compute[75239]:       <target dev="tapfeab83fb-4c"/>
Nov 13 20:54:20 user nova-compute[75239]:     </interface>
Nov 13 20:54:20 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:54:20 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/console.log" append="off"/>
Nov 13 20:54:20 user nova-compute[75239]:     </serial>
Nov 13 20:54:20 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:54:20 user nova-compute[75239]:     <video>
Nov 13 20:54:20 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:54:20 user nova-compute[75239]:     </video>
Nov 13 20:54:20 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:54:20 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:54:20 user nova-compute[75239]:     </rng>
Nov 13 20:54:20 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:54:20 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:54:20 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:54:20 user nova-compute[75239]:     </memballoon>
Nov 13 20:54:20 user nova-compute[75239]:   </devices>
Nov 13 20:54:20 user nova-compute[75239]: </domain>
Nov 13 20:54:20 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1520121881',display_name='tempest-ServersNegativeTestJSON-server-1520121881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1520121881',id=42,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='617b57945a52486a96a05958d9850e06',ramdisk_id='',reservation_id='r-60jri1du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-462526943',owner_user_name='tempest-ServersNegativeTestJSON-462526943-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:54:19Z,user_data=None,user_id='e79a6935af1f47cebd04dcb0ec9e487e',uuid=6f043e92-ecf4-48f2-b6a7-ce6b55e40b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converting VIF {"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fb:c3,bridge_name='br-int',has_traffic_filtering=True,id=feab83fb-4c10-4bf3-97a2-557dc85567e9,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeab83fb-4c') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG os_vif [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fb:c3,bridge_name='br-int',has_traffic_filtering=True,id=feab83fb-4c10-4bf3-97a2-557dc85567e9,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeab83fb-4c') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '01dafa9e-1fd9-555a-a652-8ac0adef6966', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfeab83fb-4c, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfeab83fb-4c, col_values=(('qos', UUID('1bc2b570-67dd-468c-a3dd-ac43d1da174b')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfeab83fb-4c, col_values=(('external_ids', {'iface-id': 'feab83fb-4c10-4bf3-97a2-557dc85567e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:fb:c3', 'vm-uuid': '6f043e92-ecf4-48f2-b6a7-ce6b55e40b27'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:54:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:21 user nova-compute[75239]: INFO os_vif [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fb:c3,bridge_name='br-int',has_traffic_filtering=True,id=feab83fb-4c10-4bf3-97a2-557dc85567e9,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeab83fb-4c')
Nov 13 20:54:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:54:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] No VIF found with MAC fa:16:3e:4b:fb:c3, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:54:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:21 user nova-compute[75239]: DEBUG nova.network.neutron [req-aa0e88f7-03c3-4355-a5e1-b36e67ec421b req-b0775b76-3037-4515-bce2-5b6293966f94 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Updated VIF entry in instance network info cache for port feab83fb-4c10-4bf3-97a2-557dc85567e9. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:54:21 user nova-compute[75239]: DEBUG nova.network.neutron [req-aa0e88f7-03c3-4355-a5e1-b36e67ec421b req-b0775b76-3037-4515-bce2-5b6293966f94 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Updating instance_info_cache with network_info: [{"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:54:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-aa0e88f7-03c3-4355-a5e1-b36e67ec421b req-b0775b76-3037-4515-bce2-5b6293966f94 service nova] Releasing lock "refresh_cache-6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:54:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-1d2808f8-8a77-4978-93c9-e0df7fb8fcb8 req-d026ca99-04f1-415d-b8c7-cb9a056affeb service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received event network-vif-plugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:54:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1d2808f8-8a77-4978-93c9-e0df7fb8fcb8 req-d026ca99-04f1-415d-b8c7-cb9a056affeb service nova] Acquiring lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1d2808f8-8a77-4978-93c9-e0df7fb8fcb8 req-d026ca99-04f1-415d-b8c7-cb9a056affeb service nova] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1d2808f8-8a77-4978-93c9-e0df7fb8fcb8 req-d026ca99-04f1-415d-b8c7-cb9a056affeb service nova] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-1d2808f8-8a77-4978-93c9-e0df7fb8fcb8 req-d026ca99-04f1-415d-b8c7-cb9a056affeb service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] No waiting events found dispatching network-vif-plugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:54:23 user nova-compute[75239]: WARNING nova.compute.manager [req-1d2808f8-8a77-4978-93c9-e0df7fb8fcb8 req-d026ca99-04f1-415d-b8c7-cb9a056affeb service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received unexpected event network-vif-plugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 for instance with vm_state building and task_state spawning.
Nov 13 20:54:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:54:24 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Instance spawned successfully.
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:54:24 user nova-compute[75239]: INFO nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:24 user nova-compute[75239]: INFO nova.compute.manager [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Detaching volume 54ea501d-5f7a-4df5-a196-a4de8b51abe7
Nov 13 20:54:24 user nova-compute[75239]: INFO nova.compute.manager [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Took 6.49 seconds to build instance.
Nov 13 20:54:24 user nova-compute[75239]: INFO nova.virt.block_device [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Attempting to driver detach volume 54ea501d-5f7a-4df5-a196-a4de8b51abe7 from mountpoint /dev/vdb
Nov 13 20:54:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fd6270e1-b4d9-4337-a089-daa27888d39f tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.594s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Attempting to detach device vdb from instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:54:24 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:54:24 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:54:24 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:54:24 user nova-compute[75239]:   <serial>54ea501d-5f7a-4df5-a196-a4de8b51abe7</serial>
Nov 13 20:54:24 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:54:24 user nova-compute[75239]: </disk>
Nov 13 20:54:24 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:54:24 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully detached device vdb from instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 from the persistent domain config.
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:54:24 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:54:24 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:54:24 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:54:24 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:54:24 user nova-compute[75239]:   <serial>54ea501d-5f7a-4df5-a196-a4de8b51abe7</serial>
Nov 13 20:54:24 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:54:24 user nova-compute[75239]: </disk>
Nov 13 20:54:24 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:54:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-800f7294-d673-48b7-b4d1-09e5ee170f7a req-c25bffc4-90a7-4ea5-b287-ccd470343b35 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received event network-vif-plugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:54:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-800f7294-d673-48b7-b4d1-09e5ee170f7a req-c25bffc4-90a7-4ea5-b287-ccd470343b35 service nova] Acquiring lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-800f7294-d673-48b7-b4d1-09e5ee170f7a req-c25bffc4-90a7-4ea5-b287-ccd470343b35 service nova] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-800f7294-d673-48b7-b4d1-09e5ee170f7a req-c25bffc4-90a7-4ea5-b287-ccd470343b35 service nova] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-800f7294-d673-48b7-b4d1-09e5ee170f7a req-c25bffc4-90a7-4ea5-b287-ccd470343b35 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] No waiting events found dispatching network-vif-plugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:54:25 user nova-compute[75239]: WARNING nova.compute.manager [req-800f7294-d673-48b7-b4d1-09e5ee170f7a req-c25bffc4-90a7-4ea5-b287-ccd470343b35 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received unexpected event network-vif-plugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 for instance with vm_state active and task_state None.
Nov 13 20:54:25 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:54:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:54:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 20:54:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:54:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:54:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:39 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:40 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:54:40 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8361MB free_disk=24.91451644897461GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c0591fd1-adfd-4626-806a-a71f46c80400 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance b585521b-0f65-4358-9830-a971e75a8705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 82cbd069-61e0-4858-83e8-29c90791bbed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:54:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:54:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:41 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:54:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:54:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:54:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:54:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:54:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:54:45 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 is timed out.
Nov 13 20:54:45 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully detached device vdb from instance 4db9d6bf-a3f0-4495-af7c-272e74e34324 from the live domain config.
Nov 13 20:54:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YdnAMvaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:54:45 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da50967-ffaf-4bc7-998e-6c37b4347163]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:54:45 user nova-compute[75239]: No targets found.
Nov 13 20:54:45 user nova-compute[75239]: iSNS:
Nov 13 20:54:45 user nova-compute[75239]: No targets found.
Nov 13 20:54:45 user nova-compute[75239]: STATIC:
Nov 13 20:54:45 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7
Nov 13 20:54:45 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:54:45 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:54:45 user nova-compute[75239]: FIRMWARE:
Nov 13 20:54:45 user nova-compute[75239]: No targets found.
Nov 13 20:54:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:54:45 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:54:45 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4122b55c-db9c-4452-9d5c-92488bed2267]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd5a84f-d8b8-484a-a08c-163898468183]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 (non-flash)
Nov 13 20:54:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 (non-flash)
Nov 13 20:54:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605cbf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c24e54-437a-4f0b-8a0d-076e8ffb08fa]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a69f44-c0b7-46dc-b8ef-1d9c9c4ce8ad]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d8cab2-6a1e-4489-b6ca-be541edc384c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1711c482-e060-49d1-9973-50ef0f173dab]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c37fb1-9429-441d-b3d4-fcf608ff7ee5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[524fda54-cfd9-410c-a712-6419bc758444]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7, portal: 172.16.0.220,3260]
Nov 13 20:54:45 user nova-compute[75239]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7, portal: 172.16.0.220,3260] successful.
Nov 13 20:54:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54ea501d-5f7a-4df5-a196-a4de8b51abe7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d97705e-3c42-4cd0-bf7c-0ae74ea95dff]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] <== disconnect_volume: return (292ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:54:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:54:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:46 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'flavor' on Instance uuid 4db9d6bf-a3f0-4495-af7c-272e74e34324 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:54:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d49f286-56cd-41cf-899c-6ce8aa220443 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.831s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:48 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:54:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:49 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:54:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:54:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:54:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:54:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:54:51 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:54:51 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updating instance_info_cache with network_info: [{"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:54:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:54:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:54:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-ff228126-6998-4413-907f-02868ed14f83 req-f173b518-5c59-4d07-8fc5-b16036f765da service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received event network-changed-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-ff228126-6998-4413-907f-02868ed14f83 req-f173b518-5c59-4d07-8fc5-b16036f765da service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Refreshing instance network info cache due to event network-changed-ca3b5551-7790-4f29-8f1c-17049e46bc86. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ff228126-6998-4413-907f-02868ed14f83 req-f173b518-5c59-4d07-8fc5-b16036f765da service nova] Acquiring lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ff228126-6998-4413-907f-02868ed14f83 req-f173b518-5c59-4d07-8fc5-b16036f765da service nova] Acquired lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-ff228126-6998-4413-907f-02868ed14f83 req-f173b518-5c59-4d07-8fc5-b16036f765da service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Refreshing network info cache for port ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-ff228126-6998-4413-907f-02868ed14f83 req-f173b518-5c59-4d07-8fc5-b16036f765da service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updated VIF entry in instance network info cache for port ca3b5551-7790-4f29-8f1c-17049e46bc86. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-ff228126-6998-4413-907f-02868ed14f83 req-f173b518-5c59-4d07-8fc5-b16036f765da service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updating instance_info_cache with network_info: [{"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ff228126-6998-4413-907f-02868ed14f83 req-f173b518-5c59-4d07-8fc5-b16036f765da service nova] Releasing lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lazy-loading 'flavor' on Instance uuid b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:54:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:54:55 user nova-compute[75239]: INFO nova.compute.manager [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Attaching volume 53546700-927a-4f21-8b84-a04692180ed3 to /dev/vdb
Nov 13 20:54:55 user nova-compute[75239]: DEBUG os_brick.utils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ea23f0-8822-4e14-b555-7a374339cc1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdc00af-ed32-44fd-bb50-e39e67002d06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.044s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d04d6d1-17f8-4d5f-a90c-1dfdec0bd99f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d115ade6-253d-4c03-898b-4aa52e9dbe55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:54:55 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:54:55 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9956faa8-3f8e-4951-8030-aa318cdcdab7]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG os_brick.utils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:54:55 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updating existing volume attachment record: 9633edc8-96e0-4387-915f-8057ebbbd2f9 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:54:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkDJiURB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:54:59 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:54:59 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:54:59 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b76bdb-0824-48eb-982e-54fe3396d89e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:54:59 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[207991f8-6956-4a4f-ae4f-58f5c181d64b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3] added
Nov 13 20:54:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6d4850-f659-4831-b8f9-717503461fb5]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3983a6ff-e200-46ad-bc88-aa31f800bb64]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkDJiURB {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkDJiURB" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6da6c9-bcc4-42b2-9996-b2d0d2a0ac07]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WkDJiURB'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4538901b-cd83-40a4-9d60-c7bea8d58a1f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a728b1eb-b0ff-418f-9857-ea3ff8c17ebb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:54:59 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:54:59 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:54:59 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 20:54:59 user nova-compute[75239]: 
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7535c8-8781-428f-bc2b-abd439fdc46a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3, portal: 172.16.0.220,3260]
Nov 13 20:54:59 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3, portal: 172.16.0.220,3260] successful.
Nov 13 20:54:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e52fd9-5b53-4f44-88a4-507269d46fce]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89cbc16-41fd-4c1f-99ba-bfb6d03af984]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:54:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:54:59 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd668a27-dce7-4a9c-b88d-cda319cb7243]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:54:59 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:55:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:55:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkDJiURB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:55:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:55:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26462346638383937', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:55:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462346638383937', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:55:00 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lazy-loading 'flavor' on Instance uuid b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:55:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:55:00 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:55:00 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:55:00 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:55:00 user nova-compute[75239]:   <serial>53546700-927a-4f21-8b84-a04692180ed3</serial>
Nov 13 20:55:00 user nova-compute[75239]: </disk>
Nov 13 20:55:00 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:55:00 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:55:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:55:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] No VIF found with MAC fa:16:3e:6b:ca:c0, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:55:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b5da2415-6ebc-406f-bc5d-1816e5746644 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.091s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:55:03 user nova-compute[75239]: INFO nova.compute.claims [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Claim successful on node user
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:55:03 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.policy [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74903f6cc0014ec89048e94ef4c6ba9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52bf0396a2c344cd818be8120ecaa5cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:55:03 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Creating image(s)
Nov 13 20:55:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "/opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "/opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG nova.objects.instance [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lazy-loading 'flavor' on Instance uuid b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.191s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk 1073741824" returned: 0 in 0.048s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:04 user nova-compute[75239]: INFO nova.compute.manager [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Attaching volume 5bd3e009-bd35-4496-b39d-ada7dc55ca23 to /dev/vdc
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.197s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG os_brick.utils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e001b364-8881-49ac-9d2d-a8b37c32d398]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29a8956-0334-4d8e-8241-21baaba256a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[81736a87-aab0-46d7-a66a-4eab2f762101]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec60a73b-a48f-4278-a7c7-e87f81d5cf26]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Cannot resize image /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Ensure instance console log exists: /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:55:04 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:55:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ac5dcc-5faa-4184-ab14-65667fe7de20]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Successfully created port: e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG os_brick.utils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:55:04 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updating existing volume attachment record: c0cf7b20-d5bb-44a2-8f00-91d98f746d8c {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Successfully updated port: e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquired lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-8af3f2f7-ed3d-4c23-a412-085c92fcf721 req-05e1c68e-350c-45c9-86cd-d212633acefb service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received event network-changed-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-8af3f2f7-ed3d-4c23-a412-085c92fcf721 req-05e1c68e-350c-45c9-86cd-d212633acefb service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Refreshing instance network info cache due to event network-changed-e6a43c21-a34e-4c66-9a7c-65de4df750b2. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8af3f2f7-ed3d-4c23-a412-085c92fcf721 req-05e1c68e-350c-45c9-86cd-d212633acefb service nova] Acquiring lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating instance_info_cache with network_info: [{"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Releasing lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Instance network_info: |[{"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8af3f2f7-ed3d-4c23-a412-085c92fcf721 req-05e1c68e-350c-45c9-86cd-d212633acefb service nova] Acquired lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.network.neutron [req-8af3f2f7-ed3d-4c23-a412-085c92fcf721 req-05e1c68e-350c-45c9-86cd-d212633acefb service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Refreshing network info cache for port e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Start _get_guest_xml network_info=[{"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:55:05 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:55:05 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1633693772',display_name='tempest-SnapshotDataIntegrityTests-server-1633693772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1633693772',id=43,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5Wwjpn9UBw8N17A5znuv1GYP5BlsCMqohnhm1y8uEWdhyPsApBegcvAG8y083Bceg7hOQ36rMRAc4MV7rYQ4g8mYUzk7tp50HT06jKH6evFmDJoA5zhpVXEuQ3+CzIkg==',key_name='tempest-keypair-88762707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52bf0396a2c344cd818be8120ecaa5cb',ramdisk_id='',reservation_id='r-54p7zsz3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1386629735',owner_user_name='tempest-SnapshotDataIntegrityTests-1386629735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:55:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74903f6cc0014ec89048e94ef4c6ba9e',uuid=a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Converting VIF {"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c9:f0,bridge_name='br-int',has_traffic_filtering=True,id=e6a43c21-a34e-4c66-9a7c-65de4df750b2,network=Network(b06f2285-1028-4613-b7cd-0e8f2bb58507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a43c21-a3') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.objects.instance [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'pci_devices' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:55:05 user nova-compute[75239]:   <uuid>a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c</uuid>
Nov 13 20:55:05 user nova-compute[75239]:   <name>instance-0000002b</name>
Nov 13 20:55:05 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:55:05 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:55:05 user nova-compute[75239]:   <metadata>
Nov 13 20:55:05 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:55:05 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:55:05 user nova-compute[75239]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1633693772</nova:name>
Nov 13 20:55:05 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:55:05</nova:creationTime>
Nov 13 20:55:05 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:55:05 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:55:05 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:55:05 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:55:05 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:55:05 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:55:05 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:55:05 user nova-compute[75239]:       <nova:owner>
Nov 13 20:55:05 user nova-compute[75239]:         <nova:user uuid="74903f6cc0014ec89048e94ef4c6ba9e">tempest-SnapshotDataIntegrityTests-1386629735-project-member</nova:user>
Nov 13 20:55:05 user nova-compute[75239]:         <nova:project uuid="52bf0396a2c344cd818be8120ecaa5cb">tempest-SnapshotDataIntegrityTests-1386629735</nova:project>
Nov 13 20:55:05 user nova-compute[75239]:       </nova:owner>
Nov 13 20:55:05 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:55:05 user nova-compute[75239]:       <nova:ports>
Nov 13 20:55:05 user nova-compute[75239]:         <nova:port uuid="e6a43c21-a34e-4c66-9a7c-65de4df750b2">
Nov 13 20:55:05 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:55:05 user nova-compute[75239]:         </nova:port>
Nov 13 20:55:05 user nova-compute[75239]:       </nova:ports>
Nov 13 20:55:05 user nova-compute[75239]:     </nova:instance>
Nov 13 20:55:05 user nova-compute[75239]:   </metadata>
Nov 13 20:55:05 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:55:05 user nova-compute[75239]:     <system>
Nov 13 20:55:05 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:55:05 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:55:05 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:55:05 user nova-compute[75239]:       <entry name="serial">a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c</entry>
Nov 13 20:55:05 user nova-compute[75239]:       <entry name="uuid">a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c</entry>
Nov 13 20:55:05 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:55:05 user nova-compute[75239]:     </system>
Nov 13 20:55:05 user nova-compute[75239]:   </sysinfo>
Nov 13 20:55:05 user nova-compute[75239]:   <os>
Nov 13 20:55:05 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:55:05 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:55:05 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:55:05 user nova-compute[75239]:   </os>
Nov 13 20:55:05 user nova-compute[75239]:   <features>
Nov 13 20:55:05 user nova-compute[75239]:     <acpi/>
Nov 13 20:55:05 user nova-compute[75239]:     <apic/>
Nov 13 20:55:05 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:55:05 user nova-compute[75239]:   </features>
Nov 13 20:55:05 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:55:05 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:55:05 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:55:05 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:55:05 user nova-compute[75239]:   </clock>
Nov 13 20:55:05 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:55:05 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:55:05 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:55:05 user nova-compute[75239]:   </cpu>
Nov 13 20:55:05 user nova-compute[75239]:   <devices>
Nov 13 20:55:05 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:55:05 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:55:05 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk"/>
Nov 13 20:55:05 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:55:05 user nova-compute[75239]:     </disk>
Nov 13 20:55:05 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:55:05 user nova-compute[75239]:       <mac address="fa:16:3e:01:c9:f0"/>
Nov 13 20:55:05 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:55:05 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:55:05 user nova-compute[75239]:       <target dev="tape6a43c21-a3"/>
Nov 13 20:55:05 user nova-compute[75239]:     </interface>
Nov 13 20:55:05 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:55:05 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/console.log" append="off"/>
Nov 13 20:55:05 user nova-compute[75239]:     </serial>
Nov 13 20:55:05 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:55:05 user nova-compute[75239]:     <video>
Nov 13 20:55:05 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:55:05 user nova-compute[75239]:     </video>
Nov 13 20:55:05 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:55:05 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:55:05 user nova-compute[75239]:     </rng>
Nov 13 20:55:05 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:55:05 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:55:05 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:55:05 user nova-compute[75239]:     </memballoon>
Nov 13 20:55:05 user nova-compute[75239]:   </devices>
Nov 13 20:55:05 user nova-compute[75239]: </domain>
Nov 13 20:55:05 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1633693772',display_name='tempest-SnapshotDataIntegrityTests-server-1633693772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1633693772',id=43,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5Wwjpn9UBw8N17A5znuv1GYP5BlsCMqohnhm1y8uEWdhyPsApBegcvAG8y083Bceg7hOQ36rMRAc4MV7rYQ4g8mYUzk7tp50HT06jKH6evFmDJoA5zhpVXEuQ3+CzIkg==',key_name='tempest-keypair-88762707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52bf0396a2c344cd818be8120ecaa5cb',ramdisk_id='',reservation_id='r-54p7zsz3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1386629735',owner_user_name='tempest-SnapshotDataIntegrityTests-1386629735-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:55:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74903f6cc0014ec89048e94ef4c6ba9e',uuid=a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Converting VIF {"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:c9:f0,bridge_name='br-int',has_traffic_filtering=True,id=e6a43c21-a34e-4c66-9a7c-65de4df750b2,network=Network(b06f2285-1028-4613-b7cd-0e8f2bb58507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a43c21-a3') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG os_vif [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c9:f0,bridge_name='br-int',has_traffic_filtering=True,id=e6a43c21-a34e-4c66-9a7c-65de4df750b2,network=Network(b06f2285-1028-4613-b7cd-0e8f2bb58507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a43c21-a3') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4da5d309-85d1-542d-bff7-855c9cfb7a53', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6a43c21-a3, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6a43c21-a3, col_values=(('qos', UUID('74054b94-d93d-4286-9d79-c85a310f8520')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6a43c21-a3, col_values=(('external_ids', {'iface-id': 'e6a43c21-a34e-4c66-9a7c-65de4df750b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:c9:f0', 'vm-uuid': 'a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:05 user nova-compute[75239]: INFO os_vif [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:c9:f0,bridge_name='br-int',has_traffic_filtering=True,id=e6a43c21-a34e-4c66-9a7c-65de4df750b2,network=Network(b06f2285-1028-4613-b7cd-0e8f2bb58507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a43c21-a3')
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:55:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No VIF found with MAC fa:16:3e:01:c9:f0, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:55:06 user nova-compute[75239]: DEBUG nova.network.neutron [req-8af3f2f7-ed3d-4c23-a412-085c92fcf721 req-05e1c68e-350c-45c9-86cd-d212633acefb service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updated VIF entry in instance network info cache for port e6a43c21-a34e-4c66-9a7c-65de4df750b2. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:55:06 user nova-compute[75239]: DEBUG nova.network.neutron [req-8af3f2f7-ed3d-4c23-a412-085c92fcf721 req-05e1c68e-350c-45c9-86cd-d212633acefb service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating instance_info_cache with network_info: [{"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:55:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8af3f2f7-ed3d-4c23-a412-085c92fcf721 req-05e1c68e-350c-45c9-86cd-d212633acefb service nova] Releasing lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-33517d20-8ecc-4461-9e35-4f31b76187ae req-f5653c3d-ea1b-435f-9638-25411610a896 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received event network-vif-plugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-33517d20-8ecc-4461-9e35-4f31b76187ae req-f5653c3d-ea1b-435f-9638-25411610a896 service nova] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-33517d20-8ecc-4461-9e35-4f31b76187ae req-f5653c3d-ea1b-435f-9638-25411610a896 service nova] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-33517d20-8ecc-4461-9e35-4f31b76187ae req-f5653c3d-ea1b-435f-9638-25411610a896 service nova] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-33517d20-8ecc-4461-9e35-4f31b76187ae req-f5653c3d-ea1b-435f-9638-25411610a896 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] No waiting events found dispatching network-vif-plugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:55:07 user nova-compute[75239]: WARNING nova.compute.manager [req-33517d20-8ecc-4461-9e35-4f31b76187ae req-f5653c3d-ea1b-435f-9638-25411610a896 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received unexpected event network-vif-plugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 for instance with vm_state building and task_state spawning.
Nov 13 20:55:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmoXlsvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:55:08 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:55:08 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:55:08 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfcf094-f49e-4571-a89b-8d7d0eb5d362]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:55:08 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceae5484-33d1-4165-adab-7895ae961dc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23] added
Nov 13 20:55:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc1920c-17c4-436b-9140-53fe731ac989]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e726c5-0cbb-4e38-b796-5f17edca570d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmoXlsvA {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HmoXlsvA" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d267bc-913f-4e7c-aef9-9b8b05991308]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HmoXlsvA'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d47044-8a95-48d2-a5df-4e7851ddbe6d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[216c28ca-8482-45dd-9f8d-0108cd92f465]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:55:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1696adc9-6fc8-44f2-813f-ac42d4e13622]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23, portal: 172.16.0.220,3260]
Nov 13 20:55:09 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23, portal: 172.16.0.220,3260] successful.
Nov 13 20:55:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[de68249f-7a7c-4c38-b324-c0116aa83357]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e05017-050a-4aa8-8748-ce858f509de2]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:09 user nova-compute[75239]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 (non-flash)
Nov 13 20:55:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:09 user nova-compute[75239]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 (non-flash)
Nov 13 20:55:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c2719d-9e47-4107-9395-91d56009800c]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmoXlsvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:55:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Instance spawned successfully.
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-638f9c30-dac2-4016-b8df-c0435693b15c req-9d3aef66-21ff-4ff0-beb0-f9fd9c69c503 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received event network-vif-plugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-638f9c30-dac2-4016-b8df-c0435693b15c req-9d3aef66-21ff-4ff0-beb0-f9fd9c69c503 service nova] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-638f9c30-dac2-4016-b8df-c0435693b15c req-9d3aef66-21ff-4ff0-beb0-f9fd9c69c503 service nova] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-638f9c30-dac2-4016-b8df-c0435693b15c req-9d3aef66-21ff-4ff0-beb0-f9fd9c69c503 service nova] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-638f9c30-dac2-4016-b8df-c0435693b15c req-9d3aef66-21ff-4ff0-beb0-f9fd9c69c503 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] No waiting events found dispatching network-vif-plugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:55:09 user nova-compute[75239]: WARNING nova.compute.manager [req-638f9c30-dac2-4016-b8df-c0435693b15c req-9d3aef66-21ff-4ff0-beb0-f9fd9c69c503 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received unexpected event network-vif-plugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 for instance with vm_state building and task_state spawning.
Nov 13 20:55:09 user nova-compute[75239]: INFO nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 13 20:55:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:55:09 user nova-compute[75239]: INFO nova.compute.manager [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Took 6.23 seconds to build instance.
Nov 13 20:55:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0759ea18-ac54-40bd-8294-f58e2271e821 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.320s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23937653562653362', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937653562653362', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG nova.objects.instance [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lazy-loading 'flavor' on Instance uuid b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:55:10 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:55:10 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:55:10 user nova-compute[75239]:   <target dev="vdc" bus="virtio"/>
Nov 13 20:55:10 user nova-compute[75239]:   <serial>5bd3e009-bd35-4496-b39d-ada7dc55ca23</serial>
Nov 13 20:55:10 user nova-compute[75239]: </disk>
Nov 13 20:55:10 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] No VIF found with MAC fa:16:3e:6b:ca:c0, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-20af8052-0ba8-40a5-98db-3f2d0ff0f312 tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.142s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:11 user nova-compute[75239]: INFO nova.compute.manager [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Detaching volume 5bd3e009-bd35-4496-b39d-ada7dc55ca23
Nov 13 20:55:11 user nova-compute[75239]: INFO nova.virt.block_device [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Attempting to driver detach volume 5bd3e009-bd35-4496-b39d-ada7dc55ca23 from mountpoint /dev/vdc
Nov 13 20:55:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Attempting to detach device vdc from instance b585521b-0f65-4358-9830-a971e75a8705 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:55:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:55:11 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:55:11 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:55:11 user nova-compute[75239]:   <target dev="vdc" bus="virtio"/>
Nov 13 20:55:11 user nova-compute[75239]:   <serial>5bd3e009-bd35-4496-b39d-ada7dc55ca23</serial>
Nov 13 20:55:11 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 20:55:11 user nova-compute[75239]: </disk>
Nov 13 20:55:11 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:55:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Successfully detached device vdc from instance b585521b-0f65-4358-9830-a971e75a8705 from the persistent domain config.
Nov 13 20:55:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b585521b-0f65-4358-9830-a971e75a8705 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:55:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:55:11 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:55:11 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:55:11 user nova-compute[75239]:   <target dev="vdc" bus="virtio"/>
Nov 13 20:55:11 user nova-compute[75239]:   <serial>5bd3e009-bd35-4496-b39d-ada7dc55ca23</serial>
Nov 13 20:55:11 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 20:55:11 user nova-compute[75239]: </disk>
Nov 13 20:55:11 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:55:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:55:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:15 user nova-compute[75239]: INFO nova.compute.manager [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Terminating instance
Nov 13 20:55:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-169464f6-029a-4362-a153-635f4fd83adc req-2306a6cc-fe16-4c4b-9a36-cff80d21dab7 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received event network-vif-unplugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-169464f6-029a-4362-a153-635f4fd83adc req-2306a6cc-fe16-4c4b-9a36-cff80d21dab7 service nova] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-169464f6-029a-4362-a153-635f4fd83adc req-2306a6cc-fe16-4c4b-9a36-cff80d21dab7 service nova] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-169464f6-029a-4362-a153-635f4fd83adc req-2306a6cc-fe16-4c4b-9a36-cff80d21dab7 service nova] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-169464f6-029a-4362-a153-635f4fd83adc req-2306a6cc-fe16-4c4b-9a36-cff80d21dab7 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] No waiting events found dispatching network-vif-unplugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-169464f6-029a-4362-a153-635f4fd83adc req-2306a6cc-fe16-4c4b-9a36-cff80d21dab7 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received event network-vif-unplugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:55:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Instance destroyed successfully.
Nov 13 20:55:16 user nova-compute[75239]: DEBUG nova.objects.instance [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'resources' on Instance uuid 4db9d6bf-a3f0-4495-af7c-272e74e34324 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:49:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-187280661',display_name='tempest-AttachVolumeNegativeTest-server-187280661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-187280661',id=35,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDqpIXkhSbfpjtpk9hLOJzTgZ0v2MINy2kx2o8Yt45HF42sFpMMiYqu1EBu68v5VfcaczxV8PSou5u+l1hXoOBjsTepLhp7EXtBvK66UrBGIIyfF+VL3HIGeQTKXnvUZA==',key_name='tempest-keypair-188463361',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:49:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-m471xd2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:49:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=4db9d6bf-a3f0-4495-af7c-272e74e34324,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "address": "fa:16:3e:92:30:7d", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcadda64b-9f", "ovs_interfaceid": "cadda64b-9f2a-4646-ab61-aa289f7809b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=cadda64b-9f2a-4646-ab61-aa289f7809b3,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadda64b-9f') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG os_vif [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=cadda64b-9f2a-4646-ab61-aa289f7809b3,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadda64b-9f') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcadda64b-9f, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b0c3ff9-d31c-47f2-b74b-5aafc055dddd) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:16 user nova-compute[75239]: INFO os_vif [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:30:7d,bridge_name='br-int',has_traffic_filtering=True,id=cadda64b-9f2a-4646-ab61-aa289f7809b3,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcadda64b-9f')
Nov 13 20:55:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Deleting instance files /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324_del
Nov 13 20:55:16 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Deletion of /opt/stack/data/nova/instances/4db9d6bf-a3f0-4495-af7c-272e74e34324_del complete
Nov 13 20:55:16 user nova-compute[75239]: INFO nova.compute.manager [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 13 20:55:16 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:55:16 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Took 0.79 seconds to deallocate network for instance.
Nov 13 20:55:16 user nova-compute[75239]: DEBUG nova.compute.manager [req-c128dbe4-9ba1-42a2-a8cb-af7f7eb91772 req-90b305a9-89e4-4407-a884-4df3a06bfcf1 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received event network-vif-deleted-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:16 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:17 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:55:17 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:55:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.218s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:17 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Deleted allocations for instance 4db9d6bf-a3f0-4495-af7c-272e74e34324
Nov 13 20:55:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1e90be45-e69f-42de-8ced-45543c76bd10 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-b41e6e7f-7d8b-4344-87c9-2a343c12f2ad req-e1743559-c778-480c-a456-3505e3f670b9 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received event network-vif-plugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:55:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b41e6e7f-7d8b-4344-87c9-2a343c12f2ad req-e1743559-c778-480c-a456-3505e3f670b9 service nova] Acquiring lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b41e6e7f-7d8b-4344-87c9-2a343c12f2ad req-e1743559-c778-480c-a456-3505e3f670b9 service nova] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b41e6e7f-7d8b-4344-87c9-2a343c12f2ad req-e1743559-c778-480c-a456-3505e3f670b9 service nova] Lock "4db9d6bf-a3f0-4495-af7c-272e74e34324-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:17 user nova-compute[75239]: DEBUG nova.compute.manager [req-b41e6e7f-7d8b-4344-87c9-2a343c12f2ad req-e1743559-c778-480c-a456-3505e3f670b9 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] No waiting events found dispatching network-vif-plugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:55:17 user nova-compute[75239]: WARNING nova.compute.manager [req-b41e6e7f-7d8b-4344-87c9-2a343c12f2ad req-e1743559-c778-480c-a456-3505e3f670b9 service nova] [instance: 4db9d6bf-a3f0-4495-af7c-272e74e34324] Received unexpected event network-vif-plugged-cadda64b-9f2a-4646-ab61-aa289f7809b3 for instance with vm_state deleted and task_state None.
Nov 13 20:55:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:31 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b585521b-0f65-4358-9830-a971e75a8705 is timed out.
Nov 13 20:55:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Successfully detached device vdc from instance b585521b-0f65-4358-9830-a971e75a8705 from the live domain config.
Nov 13 20:55:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HmoXlsvA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:55:31 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8fc46f-498d-4416-8da6-7e13c4f4639f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:55:31 user nova-compute[75239]: No targets found.
Nov 13 20:55:31 user nova-compute[75239]: iSNS:
Nov 13 20:55:31 user nova-compute[75239]: No targets found.
Nov 13 20:55:31 user nova-compute[75239]: STATIC:
Nov 13 20:55:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3
Nov 13 20:55:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:55:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:55:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23
Nov 13 20:55:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:55:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:55:31 user nova-compute[75239]: FIRMWARE:
Nov 13 20:55:31 user nova-compute[75239]: No targets found.
Nov 13 20:55:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:55:31 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:55:31 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830be75-7ac7-44cf-b95a-c5eec2720299]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d48e43-1ce6-46df-a0de-3d2bc560af11]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:31 user nova-compute[75239]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 (non-flash)
Nov 13 20:55:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:31 user nova-compute[75239]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 (non-flash)
Nov 13 20:55:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605c9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c350192-83a5-42cf-8031-76404eb8014d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[109864e3-5330-45fc-a38c-701afe1c05da]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5e371f-4565-4ad0-ad4a-149aa1fcc524]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fad640-2e8f-4fa0-bf7c-998bb53d79e8]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[472b100b-bf4e-405d-a6f5-fbdc65b9caa3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e69c40-1743-4605-8365-735759912687]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23, portal: 172.16.0.220,3260]
Nov 13 20:55:32 user nova-compute[75239]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23, portal: 172.16.0.220,3260] successful.
Nov 13 20:55:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd3e009-bd35-4496-b39d-ada7dc55ca23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8729be49-467a-4e63-a10b-70fffe2a7f5a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] <== disconnect_volume: return (266ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lazy-loading 'flavor' on Instance uuid b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:55:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6b0cbb03-ec33-4186-b614-9959c4c17d9d tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.579s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-7d439e4f-095b-4632-8d8d-cd8bc005be50 req-e23dec94-555f-40f1-bf8c-9121be0ca0d6 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received event network-changed-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-7d439e4f-095b-4632-8d8d-cd8bc005be50 req-e23dec94-555f-40f1-bf8c-9121be0ca0d6 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Refreshing instance network info cache due to event network-changed-3c261642-c8a9-4e66-91f6-6882d6f8a04f. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7d439e4f-095b-4632-8d8d-cd8bc005be50 req-e23dec94-555f-40f1-bf8c-9121be0ca0d6 service nova] Acquiring lock "refresh_cache-82cbd069-61e0-4858-83e8-29c90791bbed" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7d439e4f-095b-4632-8d8d-cd8bc005be50 req-e23dec94-555f-40f1-bf8c-9121be0ca0d6 service nova] Acquired lock "refresh_cache-82cbd069-61e0-4858-83e8-29c90791bbed" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG nova.network.neutron [req-7d439e4f-095b-4632-8d8d-cd8bc005be50 req-e23dec94-555f-40f1-bf8c-9121be0ca0d6 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Refreshing network info cache for port 3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-7d439e4f-095b-4632-8d8d-cd8bc005be50 req-e23dec94-555f-40f1-bf8c-9121be0ca0d6 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Updated VIF entry in instance network info cache for port 3c261642-c8a9-4e66-91f6-6882d6f8a04f. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-7d439e4f-095b-4632-8d8d-cd8bc005be50 req-e23dec94-555f-40f1-bf8c-9121be0ca0d6 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Updating instance_info_cache with network_info: [{"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-7d439e4f-095b-4632-8d8d-cd8bc005be50 req-e23dec94-555f-40f1-bf8c-9121be0ca0d6 service nova] Releasing lock "refresh_cache-82cbd069-61e0-4858-83e8-29c90791bbed" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:42 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:55:42 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8316MB free_disk=24.900718688964844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c0591fd1-adfd-4626-806a-a71f46c80400 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance b585521b-0f65-4358-9830-a971e75a8705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 82cbd069-61e0-4858-83e8-29c90791bbed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:42 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'flavor' on Instance uuid 82cbd069-61e0-4858-83e8-29c90791bbed {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:55:43 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Ignoring supplied device name: /dev/vdb
Nov 13 20:55:43 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:43 user nova-compute[75239]: INFO nova.compute.manager [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Attaching volume aabe87af-d6eb-4435-8e07-dcae06077daf to /dev/vdb
Nov 13 20:55:43 user nova-compute[75239]: DEBUG os_brick.utils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37469d-8799-49ca-a057-27e952f4d7ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[09286a75-1b92-45ea-be9d-eef95d2b3090]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[650bb98e-0ee2-4607-8275-2e2ec6e3588b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[94990af3-2824-474b-8675-841651f99df6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:55:43 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:55:43 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eec5f2-a019-4467-bff9-de0f82daca52]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG os_brick.utils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Updating existing volume attachment record: 3869633a-30dd-4382-9c83-916ff713e8f6 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:55:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:55:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmgPDiKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:55:47 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:55:47 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:55:47 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bda19b-2c22-4800-95b2-afc8dc6c1912]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:55:47 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9b30b6-1aee-4bc4-984d-dc388ec69fcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf] added
Nov 13 20:55:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cce5b4d-de85-43dd-b82d-b56804f803c3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e0e405-8629-4b83-b2eb-b66a7bb15c4e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmgPDiKd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmgPDiKd" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7077338f-59d7-49b6-ac55-1a20f59614e2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmgPDiKd'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7c246e-4e28-4317-98f7-faed4e029c39]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[548bdd7e-1227-40eb-bc66-e2d949c0bb88]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73a3193-fc67-492e-8048-49ab3e7ed147]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf, portal: 172.16.0.220,3260]
Nov 13 20:55:47 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf, portal: 172.16.0.220,3260] successful.
Nov 13 20:55:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720c85b-1a2c-4b82-ae4f-62f5a6158f5b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d48df6-1190-455e-9cb6-b561d1a5a707]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:47 user nova-compute[75239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf (non-flash)
Nov 13 20:55:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:55:47 user nova-compute[75239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf (non-flash)
Nov 13 20:55:47 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4849bd4-2bf7-473c-9c02-1d28073a7812]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:55:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmgPDiKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:55:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:55:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23431356362663134', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:55:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431356362663134', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:55:48 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'flavor' on Instance uuid 82cbd069-61e0-4858-83e8-29c90791bbed {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:55:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:55:48 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:55:48 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:55:48 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:55:48 user nova-compute[75239]:   <serial>aabe87af-d6eb-4435-8e07-dcae06077daf</serial>
Nov 13 20:55:48 user nova-compute[75239]: </disk>
Nov 13 20:55:48 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:55:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:55:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:55:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No VIF found with MAC fa:16:3e:c7:92:7c, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:55:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d1e78526-644e-40a5-bd65-b5f0e4dbb123 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.162s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:55:50 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: b585521b-0f65-4358-9830-a971e75a8705] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updating instance_info_cache with network_info: [{"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-b585521b-0f65-4358-9830-a971e75a8705" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:55:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:55:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:55:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 20:55:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:55:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 20:55:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:55:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:55:56 user nova-compute[75239]: INFO nova.compute.manager [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Detaching volume aabe87af-d6eb-4435-8e07-dcae06077daf
Nov 13 20:55:57 user nova-compute[75239]: INFO nova.virt.block_device [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Attempting to driver detach volume aabe87af-d6eb-4435-8e07-dcae06077daf from mountpoint /dev/vdb
Nov 13 20:55:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Attempting to detach device vdb from instance 82cbd069-61e0-4858-83e8-29c90791bbed from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:55:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:55:57 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:55:57 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:55:57 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:55:57 user nova-compute[75239]:   <serial>aabe87af-d6eb-4435-8e07-dcae06077daf</serial>
Nov 13 20:55:57 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:55:57 user nova-compute[75239]: </disk>
Nov 13 20:55:57 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:55:57 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Successfully detached device vdb from instance 82cbd069-61e0-4858-83e8-29c90791bbed from the persistent domain config.
Nov 13 20:55:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82cbd069-61e0-4858-83e8-29c90791bbed from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:55:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:55:57 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:55:57 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:55:57 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:55:57 user nova-compute[75239]:   <serial>aabe87af-d6eb-4435-8e07-dcae06077daf</serial>
Nov 13 20:55:57 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:55:57 user nova-compute[75239]: </disk>
Nov 13 20:55:57 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:55:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:55:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82cbd069-61e0-4858-83e8-29c90791bbed {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:55:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:01 user nova-compute[75239]: INFO nova.compute.manager [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Detaching volume 53546700-927a-4f21-8b84-a04692180ed3
Nov 13 20:56:01 user nova-compute[75239]: INFO nova.virt.block_device [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Attempting to driver detach volume 53546700-927a-4f21-8b84-a04692180ed3 from mountpoint /dev/vdb
Nov 13 20:56:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Attempting to detach device vdb from instance b585521b-0f65-4358-9830-a971e75a8705 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:56:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:56:01 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:56:01 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:56:01 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:56:01 user nova-compute[75239]:   <serial>53546700-927a-4f21-8b84-a04692180ed3</serial>
Nov 13 20:56:01 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:56:01 user nova-compute[75239]: </disk>
Nov 13 20:56:01 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:56:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Successfully detached device vdb from instance b585521b-0f65-4358-9830-a971e75a8705 from the persistent domain config.
Nov 13 20:56:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b585521b-0f65-4358-9830-a971e75a8705 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:56:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:56:01 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:56:01 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:56:01 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:56:01 user nova-compute[75239]:   <serial>53546700-927a-4f21-8b84-a04692180ed3</serial>
Nov 13 20:56:01 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:56:01 user nova-compute[75239]: </disk>
Nov 13 20:56:01 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:56:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:56:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:56:08 user nova-compute[75239]: INFO nova.compute.claims [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Claim successful on node user
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:08 user nova-compute[75239]: INFO nova.compute.manager [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Terminating instance
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.network.neutron [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:56:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-2c165cae-9031-4f18-be41-d83869ec3370 req-af421b11-747e-480a-8f87-25d39c7779ef service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received event network-vif-unplugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2c165cae-9031-4f18-be41-d83869ec3370 req-af421b11-747e-480a-8f87-25d39c7779ef service nova] Acquiring lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2c165cae-9031-4f18-be41-d83869ec3370 req-af421b11-747e-480a-8f87-25d39c7779ef service nova] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2c165cae-9031-4f18-be41-d83869ec3370 req-af421b11-747e-480a-8f87-25d39c7779ef service nova] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-2c165cae-9031-4f18-be41-d83869ec3370 req-af421b11-747e-480a-8f87-25d39c7779ef service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] No waiting events found dispatching network-vif-unplugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-2c165cae-9031-4f18-be41-d83869ec3370 req-af421b11-747e-480a-8f87-25d39c7779ef service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received event network-vif-unplugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.policy [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa7ce2c9a26e403d9d802d354b43e8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f422c15f5d0d4a62ad37feabca7faa03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:56:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Creating image(s)
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "/opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "/opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.190s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Instance destroyed successfully.
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lazy-loading 'resources' on Instance uuid 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk 1073741824" returned: 0 in 0.055s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.network.neutron [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Successfully created port: a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:54:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1520121881',display_name='tempest-ServersNegativeTestJSON-server-1520121881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1520121881',id=42,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:54:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='617b57945a52486a96a05958d9850e06',ramdisk_id='',reservation_id='r-60jri1du',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-462526943',owner_user_name='tempest-ServersNegativeTestJSON-462526943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:54:25Z,user_data=None,user_id='e79a6935af1f47cebd04dcb0ec9e487e',uuid=6f043e92-ecf4-48f2-b6a7-ce6b55e40b27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converting VIF {"id": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "address": "fa:16:3e:4b:fb:c3", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfeab83fb-4c", "ovs_interfaceid": "feab83fb-4c10-4bf3-97a2-557dc85567e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fb:c3,bridge_name='br-int',has_traffic_filtering=True,id=feab83fb-4c10-4bf3-97a2-557dc85567e9,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeab83fb-4c') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG os_vif [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fb:c3,bridge_name='br-int',has_traffic_filtering=True,id=feab83fb-4c10-4bf3-97a2-557dc85567e9,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeab83fb-4c') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfeab83fb-4c, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bc2b570-67dd-468c-a3dd-ac43d1da174b) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:09 user nova-compute[75239]: INFO os_vif [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:fb:c3,bridge_name='br-int',has_traffic_filtering=True,id=feab83fb-4c10-4bf3-97a2-557dc85567e9,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfeab83fb-4c')
Nov 13 20:56:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Deleting instance files /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27_del
Nov 13 20:56:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Deletion of /opt/stack/data/nova/instances/6f043e92-ecf4-48f2-b6a7-ce6b55e40b27_del complete
Nov 13 20:56:09 user nova-compute[75239]: INFO nova.compute.manager [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Cannot resize image /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Ensure instance console log exists: /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:10 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Took 0.61 seconds to deallocate network for instance.
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-375d0301-e40c-4efc-8894-6231f522c89c req-a706143f-8b03-422c-9588-61f1cf179be9 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received event network-vif-deleted-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:10 user nova-compute[75239]: INFO nova.compute.manager [req-375d0301-e40c-4efc-8894-6231f522c89c req-a706143f-8b03-422c-9588-61f1cf179be9 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Neutron deleted interface feab83fb-4c10-4bf3-97a2-557dc85567e9; detaching it from the instance and deleting it from the info cache
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.network.neutron [req-375d0301-e40c-4efc-8894-6231f522c89c req-a706143f-8b03-422c-9588-61f1cf179be9 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-375d0301-e40c-4efc-8894-6231f522c89c req-a706143f-8b03-422c-9588-61f1cf179be9 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Detach interface failed, port_id=feab83fb-4c10-4bf3-97a2-557dc85567e9, reason: Instance 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Successfully updated port: a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquired lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:10 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Deleted allocations for instance 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27
Nov 13 20:56:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8cb5c933-fa2b-4025-8632-4d3b666e7651 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Updating instance_info_cache with network_info: [{"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-8edd8387-13a1-4100-a460-827553bb65f2 req-d4c03ea1-4ed8-4001-bbd0-7236e081bc77 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received event network-vif-plugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8edd8387-13a1-4100-a460-827553bb65f2 req-d4c03ea1-4ed8-4001-bbd0-7236e081bc77 service nova] Acquiring lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8edd8387-13a1-4100-a460-827553bb65f2 req-d4c03ea1-4ed8-4001-bbd0-7236e081bc77 service nova] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8edd8387-13a1-4100-a460-827553bb65f2 req-d4c03ea1-4ed8-4001-bbd0-7236e081bc77 service nova] Lock "6f043e92-ecf4-48f2-b6a7-ce6b55e40b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-8edd8387-13a1-4100-a460-827553bb65f2 req-d4c03ea1-4ed8-4001-bbd0-7236e081bc77 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] No waiting events found dispatching network-vif-plugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:56:10 user nova-compute[75239]: WARNING nova.compute.manager [req-8edd8387-13a1-4100-a460-827553bb65f2 req-d4c03ea1-4ed8-4001-bbd0-7236e081bc77 service nova] [instance: 6f043e92-ecf4-48f2-b6a7-ce6b55e40b27] Received unexpected event network-vif-plugged-feab83fb-4c10-4bf3-97a2-557dc85567e9 for instance with vm_state deleted and task_state None.
Nov 13 20:56:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Releasing lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Instance network_info: |[{"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Start _get_guest_xml network_info=[{"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:56:11 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:56:11 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1448381069',display_name='tempest-AttachVolumeNegativeTest-server-1448381069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1448381069',id=44,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WBUZooIt4eiSox2oczkA4peG7iwdzZGyE4EhFWmOpM68jPNDKPyVKe17Pph5TP28KOmJOE0gdA1dllLv6vBRN+ODFKVihXGSSYEzvapTEuj8JPBgiYWiVWi5IhJoOdg==',key_name='tempest-keypair-748617141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-cpp1oczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=8cd0c72d-be0b-4ada-8149-b43f3bd52692,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=a9b5592d-d5d8-4e44-98f5-40ee4537554d,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b5592d-d5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.objects.instance [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cd0c72d-be0b-4ada-8149-b43f3bd52692 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:56:11 user nova-compute[75239]:   <uuid>8cd0c72d-be0b-4ada-8149-b43f3bd52692</uuid>
Nov 13 20:56:11 user nova-compute[75239]:   <name>instance-0000002c</name>
Nov 13 20:56:11 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:56:11 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:56:11 user nova-compute[75239]:   <metadata>
Nov 13 20:56:11 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:56:11 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:56:11 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1448381069</nova:name>
Nov 13 20:56:11 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:56:11</nova:creationTime>
Nov 13 20:56:11 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:56:11 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:56:11 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:56:11 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:56:11 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:56:11 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:56:11 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:56:11 user nova-compute[75239]:       <nova:owner>
Nov 13 20:56:11 user nova-compute[75239]:         <nova:user uuid="fa7ce2c9a26e403d9d802d354b43e8e7">tempest-AttachVolumeNegativeTest-1236383897-project-member</nova:user>
Nov 13 20:56:11 user nova-compute[75239]:         <nova:project uuid="f422c15f5d0d4a62ad37feabca7faa03">tempest-AttachVolumeNegativeTest-1236383897</nova:project>
Nov 13 20:56:11 user nova-compute[75239]:       </nova:owner>
Nov 13 20:56:11 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:56:11 user nova-compute[75239]:       <nova:ports>
Nov 13 20:56:11 user nova-compute[75239]:         <nova:port uuid="a9b5592d-d5d8-4e44-98f5-40ee4537554d">
Nov 13 20:56:11 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:56:11 user nova-compute[75239]:         </nova:port>
Nov 13 20:56:11 user nova-compute[75239]:       </nova:ports>
Nov 13 20:56:11 user nova-compute[75239]:     </nova:instance>
Nov 13 20:56:11 user nova-compute[75239]:   </metadata>
Nov 13 20:56:11 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:56:11 user nova-compute[75239]:     <system>
Nov 13 20:56:11 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:56:11 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:56:11 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:56:11 user nova-compute[75239]:       <entry name="serial">8cd0c72d-be0b-4ada-8149-b43f3bd52692</entry>
Nov 13 20:56:11 user nova-compute[75239]:       <entry name="uuid">8cd0c72d-be0b-4ada-8149-b43f3bd52692</entry>
Nov 13 20:56:11 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:56:11 user nova-compute[75239]:     </system>
Nov 13 20:56:11 user nova-compute[75239]:   </sysinfo>
Nov 13 20:56:11 user nova-compute[75239]:   <os>
Nov 13 20:56:11 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:56:11 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:56:11 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:56:11 user nova-compute[75239]:   </os>
Nov 13 20:56:11 user nova-compute[75239]:   <features>
Nov 13 20:56:11 user nova-compute[75239]:     <acpi/>
Nov 13 20:56:11 user nova-compute[75239]:     <apic/>
Nov 13 20:56:11 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:56:11 user nova-compute[75239]:   </features>
Nov 13 20:56:11 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:56:11 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:56:11 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:56:11 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:56:11 user nova-compute[75239]:   </clock>
Nov 13 20:56:11 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:56:11 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:56:11 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:56:11 user nova-compute[75239]:   </cpu>
Nov 13 20:56:11 user nova-compute[75239]:   <devices>
Nov 13 20:56:11 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:56:11 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:56:11 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk"/>
Nov 13 20:56:11 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:56:11 user nova-compute[75239]:     </disk>
Nov 13 20:56:11 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:56:11 user nova-compute[75239]:       <mac address="fa:16:3e:f6:0c:36"/>
Nov 13 20:56:11 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:56:11 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:56:11 user nova-compute[75239]:       <target dev="tapa9b5592d-d5"/>
Nov 13 20:56:11 user nova-compute[75239]:     </interface>
Nov 13 20:56:11 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:56:11 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/console.log" append="off"/>
Nov 13 20:56:11 user nova-compute[75239]:     </serial>
Nov 13 20:56:11 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:56:11 user nova-compute[75239]:     <video>
Nov 13 20:56:11 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:56:11 user nova-compute[75239]:     </video>
Nov 13 20:56:11 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:56:11 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:56:11 user nova-compute[75239]:     </rng>
Nov 13 20:56:11 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:56:11 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:56:11 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:56:11 user nova-compute[75239]:     </memballoon>
Nov 13 20:56:11 user nova-compute[75239]:   </devices>
Nov 13 20:56:11 user nova-compute[75239]: </domain>
Nov 13 20:56:11 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1448381069',display_name='tempest-AttachVolumeNegativeTest-server-1448381069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1448381069',id=44,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WBUZooIt4eiSox2oczkA4peG7iwdzZGyE4EhFWmOpM68jPNDKPyVKe17Pph5TP28KOmJOE0gdA1dllLv6vBRN+ODFKVihXGSSYEzvapTEuj8JPBgiYWiVWi5IhJoOdg==',key_name='tempest-keypair-748617141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-cpp1oczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=8cd0c72d-be0b-4ada-8149-b43f3bd52692,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=a9b5592d-d5d8-4e44-98f5-40ee4537554d,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b5592d-d5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG os_vif [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=a9b5592d-d5d8-4e44-98f5-40ee4537554d,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b5592d-d5') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff92b495-aab8-5780-8382-afd49a14a620', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9b5592d-d5, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9b5592d-d5, col_values=(('qos', UUID('9acf3360-807b-42cc-b2b5-5eaf40daf4c6')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9b5592d-d5, col_values=(('external_ids', {'iface-id': 'a9b5592d-d5d8-4e44-98f5-40ee4537554d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:0c:36', 'vm-uuid': '8cd0c72d-be0b-4ada-8149-b43f3bd52692'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:11 user nova-compute[75239]: INFO os_vif [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=a9b5592d-d5d8-4e44-98f5-40ee4537554d,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b5592d-d5')
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:56:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No VIF found with MAC fa:16:3e:f6:0c:36, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f39e32e-f8ef-425b-91b1-2c09b726c70b req-6e146c12-1470-44b8-b119-395e6ff2b36f service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received event network-changed-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-8f39e32e-f8ef-425b-91b1-2c09b726c70b req-6e146c12-1470-44b8-b119-395e6ff2b36f service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Refreshing instance network info cache due to event network-changed-a9b5592d-d5d8-4e44-98f5-40ee4537554d. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f39e32e-f8ef-425b-91b1-2c09b726c70b req-6e146c12-1470-44b8-b119-395e6ff2b36f service nova] Acquiring lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f39e32e-f8ef-425b-91b1-2c09b726c70b req-6e146c12-1470-44b8-b119-395e6ff2b36f service nova] Acquired lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG nova.network.neutron [req-8f39e32e-f8ef-425b-91b1-2c09b726c70b req-6e146c12-1470-44b8-b119-395e6ff2b36f service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Refreshing network info cache for port a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG nova.network.neutron [req-8f39e32e-f8ef-425b-91b1-2c09b726c70b req-6e146c12-1470-44b8-b119-395e6ff2b36f service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Updated VIF entry in instance network info cache for port a9b5592d-d5d8-4e44-98f5-40ee4537554d. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG nova.network.neutron [req-8f39e32e-f8ef-425b-91b1-2c09b726c70b req-6e146c12-1470-44b8-b119-395e6ff2b36f service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Updating instance_info_cache with network_info: [{"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8f39e32e-f8ef-425b-91b1-2c09b726c70b req-6e146c12-1470-44b8-b119-395e6ff2b36f service nova] Releasing lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-35ca6cea-98e3-4dec-98e2-353af9418b8f req-ba7e2ed0-e7a4-44a3-a2f4-4a92a82fc221 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received event network-vif-plugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-35ca6cea-98e3-4dec-98e2-353af9418b8f req-ba7e2ed0-e7a4-44a3-a2f4-4a92a82fc221 service nova] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-35ca6cea-98e3-4dec-98e2-353af9418b8f req-ba7e2ed0-e7a4-44a3-a2f4-4a92a82fc221 service nova] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-35ca6cea-98e3-4dec-98e2-353af9418b8f req-ba7e2ed0-e7a4-44a3-a2f4-4a92a82fc221 service nova] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-35ca6cea-98e3-4dec-98e2-353af9418b8f req-ba7e2ed0-e7a4-44a3-a2f4-4a92a82fc221 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] No waiting events found dispatching network-vif-plugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:56:12 user nova-compute[75239]: WARNING nova.compute.manager [req-35ca6cea-98e3-4dec-98e2-353af9418b8f req-ba7e2ed0-e7a4-44a3-a2f4-4a92a82fc221 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received unexpected event network-vif-plugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d for instance with vm_state building and task_state spawning.
Nov 13 20:56:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:56:14 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Instance spawned successfully.
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:56:14 user nova-compute[75239]: INFO nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:56:14 user nova-compute[75239]: INFO nova.compute.manager [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Took 6.58 seconds to build instance.
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-c67ef76f-5802-42ac-9383-80eb5cb47467 req-246324b3-1df7-4848-9195-d61f9e5e33be service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received event network-vif-plugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c67ef76f-5802-42ac-9383-80eb5cb47467 req-246324b3-1df7-4848-9195-d61f9e5e33be service nova] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c67ef76f-5802-42ac-9383-80eb5cb47467 req-246324b3-1df7-4848-9195-d61f9e5e33be service nova] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c67ef76f-5802-42ac-9383-80eb5cb47467 req-246324b3-1df7-4848-9195-d61f9e5e33be service nova] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:14 user nova-compute[75239]: DEBUG nova.compute.manager [req-c67ef76f-5802-42ac-9383-80eb5cb47467 req-246324b3-1df7-4848-9195-d61f9e5e33be service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] No waiting events found dispatching network-vif-plugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:56:14 user nova-compute[75239]: WARNING nova.compute.manager [req-c67ef76f-5802-42ac-9383-80eb5cb47467 req-246324b3-1df7-4848-9195-d61f9e5e33be service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received unexpected event network-vif-plugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d for instance with vm_state active and task_state None.
Nov 13 20:56:14 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-884ec5b9-0986-42a0-a320-2e2332be4dd2 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.681s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:17 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 82cbd069-61e0-4858-83e8-29c90791bbed is timed out.
Nov 13 20:56:17 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Successfully detached device vdb from instance 82cbd069-61e0-4858-83e8-29c90791bbed from the live domain config.
Nov 13 20:56:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmgPDiKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:56:17 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2a1553-835f-449c-8a01-67ba29a27842]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:56:17 user nova-compute[75239]: No targets found.
Nov 13 20:56:17 user nova-compute[75239]: iSNS:
Nov 13 20:56:17 user nova-compute[75239]: No targets found.
Nov 13 20:56:17 user nova-compute[75239]: STATIC:
Nov 13 20:56:17 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf
Nov 13 20:56:17 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:56:17 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:56:17 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3
Nov 13 20:56:17 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:56:17 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:56:17 user nova-compute[75239]: FIRMWARE:
Nov 13 20:56:17 user nova-compute[75239]: No targets found.
Nov 13 20:56:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:56:17 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:56:17 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bdd4c9-8f23-4d85-81e8-4f10e6e5054e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[557530e7-b96c-447b-b33a-f7c806392dce]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:56:17 user nova-compute[75239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf (non-flash)
Nov 13 20:56:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:56:17 user nova-compute[75239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf (non-flash)
Nov 13 20:56:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d602701f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a07a3-189a-4a0c-b77f-2a7b0a2982ce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb0399f-3d74-43d3-9d83-8dcdcd8cc87d]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffcdabe-09f6-431f-8577-bb2bb042dd8d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ac149a-9391-4078-8578-da62ae801279]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ebd639-57d8-4769-9737-370bfcaae77d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e928ab2-c813-4404-a83b-2f59a779cc7d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf, portal: 172.16.0.220,3260]
Nov 13 20:56:17 user nova-compute[75239]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf, portal: 172.16.0.220,3260] successful.
Nov 13 20:56:17 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52edebb-5664-4cdf-9f9e-248bd9d368fd]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] <== disconnect_volume: return (305ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:56:17 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'flavor' on Instance uuid 82cbd069-61e0-4858-83e8-29c90791bbed {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a93b311a-a185-491e-bfaf-2efb1f3adf7e tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.597s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.474s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:18 user nova-compute[75239]: INFO nova.compute.manager [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Terminating instance
Nov 13 20:56:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-68c700d3-e944-4c3b-823e-baf30a78d915 req-79a40ada-6fbf-4d01-92b6-2657172c6626 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received event network-vif-unplugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-68c700d3-e944-4c3b-823e-baf30a78d915 req-79a40ada-6fbf-4d01-92b6-2657172c6626 service nova] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-68c700d3-e944-4c3b-823e-baf30a78d915 req-79a40ada-6fbf-4d01-92b6-2657172c6626 service nova] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-68c700d3-e944-4c3b-823e-baf30a78d915 req-79a40ada-6fbf-4d01-92b6-2657172c6626 service nova] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-68c700d3-e944-4c3b-823e-baf30a78d915 req-79a40ada-6fbf-4d01-92b6-2657172c6626 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] No waiting events found dispatching network-vif-unplugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:56:18 user nova-compute[75239]: DEBUG nova.compute.manager [req-68c700d3-e944-4c3b-823e-baf30a78d915 req-79a40ada-6fbf-4d01-92b6-2657172c6626 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received event network-vif-unplugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:56:19 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Instance destroyed successfully.
Nov 13 20:56:19 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'resources' on Instance uuid 82cbd069-61e0-4858-83e8-29c90791bbed {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:53:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1838686943',display_name='tempest-VolumesSnapshotTestJSON-instance-1838686943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1838686943',id=41,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEVrmDkMNMyU4DUUGd7beJONQQQA6ghoybiPjGw4ZbPGvf1yif3CII3RQhk/D016f4rR7fSOL+WoLoj3r6VkZzUyWztw7JaGjCnM5hW20r9oYjo1llwaWRxqg4R089DDRw==',key_name='tempest-keypair-1410843722',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:53:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='909c29838280436f85a2242f1c344eef',ramdisk_id='',reservation_id='r-n1i8pzs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-77894400',owner_user_name='tempest-VolumesSnapshotTestJSON-77894400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:53:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bc1e54d23824501a21398dd0410bba1',uuid=82cbd069-61e0-4858-83e8-29c90791bbed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converting VIF {"id": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "address": "fa:16:3e:c7:92:7c", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c261642-c8", "ovs_interfaceid": "3c261642-c8a9-4e66-91f6-6882d6f8a04f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c261642-c8a9-4e66-91f6-6882d6f8a04f,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c261642-c8') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_vif [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c261642-c8a9-4e66-91f6-6882d6f8a04f,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c261642-c8') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c261642-c8, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e8bdd6c-f863-46da-8c4c-a4e921b8681d) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:56:19 user nova-compute[75239]: INFO os_vif [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:92:7c,bridge_name='br-int',has_traffic_filtering=True,id=3c261642-c8a9-4e66-91f6-6882d6f8a04f,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c261642-c8')
Nov 13 20:56:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmgPDiKd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:56:19 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc9b60c-faba-4647-b86d-17146b2fc270]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:56:19 user nova-compute[75239]: No targets found.
Nov 13 20:56:19 user nova-compute[75239]: iSNS:
Nov 13 20:56:19 user nova-compute[75239]: No targets found.
Nov 13 20:56:19 user nova-compute[75239]: STATIC:
Nov 13 20:56:19 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3
Nov 13 20:56:19 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:56:19 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:56:19 user nova-compute[75239]: FIRMWARE:
Nov 13 20:56:19 user nova-compute[75239]: No targets found.
Nov 13 20:56:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:56:19 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:56:19 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aabe87af-d6eb-4435-8e07-dcae06077daf', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6a7959-6739-4926-905d-e9cb786fd09a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9b7626-654b-4d80-acf4-66bbd07d3eff]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:56:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:56:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605d0040>, {}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Disconnecting from: [] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] <== disconnect_volume: return (80ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:56:19 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Deleting instance files /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed_del
Nov 13 20:56:19 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Deletion of /opt/stack/data/nova/instances/82cbd069-61e0-4858-83e8-29c90791bbed_del complete
Nov 13 20:56:19 user nova-compute[75239]: INFO nova.compute.manager [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 13 20:56:19 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:56:19 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:56:20 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:20 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Took 0.92 seconds to deallocate network for instance.
Nov 13 20:56:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-74cdf910-b3cc-4c21-a87d-9312a9c8337e req-90b948a5-ff6e-47c1-83e1-d82c480b5490 service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received event network-vif-deleted-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:20 user nova-compute[75239]: WARNING nova.volume.cinder [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Attachment 3869633a-30dd-4382-9c83-916ff713e8f6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3869633a-30dd-4382-9c83-916ff713e8f6. (HTTP 404) (Request-ID: req-6381647c-ee39-4e79-9038-1d9b514755e3)
Nov 13 20:56:20 user nova-compute[75239]: INFO nova.compute.manager [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Took 0.03 seconds to detach 1 volumes for instance.
Nov 13 20:56:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:20 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:56:20 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:56:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:20 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Deleted allocations for instance 82cbd069-61e0-4858-83e8-29c90791bbed
Nov 13 20:56:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-b810c32b-58b8-4f15-a083-fdc1089055ce req-c277ed8e-161e-4b14-a6fd-30675692ed7e service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received event network-vif-plugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b810c32b-58b8-4f15-a083-fdc1089055ce req-c277ed8e-161e-4b14-a6fd-30675692ed7e service nova] Acquiring lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b810c32b-58b8-4f15-a083-fdc1089055ce req-c277ed8e-161e-4b14-a6fd-30675692ed7e service nova] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b810c32b-58b8-4f15-a083-fdc1089055ce req-c277ed8e-161e-4b14-a6fd-30675692ed7e service nova] Lock "82cbd069-61e0-4858-83e8-29c90791bbed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:20 user nova-compute[75239]: DEBUG nova.compute.manager [req-b810c32b-58b8-4f15-a083-fdc1089055ce req-c277ed8e-161e-4b14-a6fd-30675692ed7e service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] No waiting events found dispatching network-vif-plugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:56:20 user nova-compute[75239]: WARNING nova.compute.manager [req-b810c32b-58b8-4f15-a083-fdc1089055ce req-c277ed8e-161e-4b14-a6fd-30675692ed7e service nova] [instance: 82cbd069-61e0-4858-83e8-29c90791bbed] Received unexpected event network-vif-plugged-3c261642-c8a9-4e66-91f6-6882d6f8a04f for instance with vm_state deleted and task_state None.
Nov 13 20:56:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2360f4e2-c1e5-4591-813f-854688dc282b tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "82cbd069-61e0-4858-83e8-29c90791bbed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.363s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:22 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b585521b-0f65-4358-9830-a971e75a8705 is timed out.
Nov 13 20:56:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Successfully detached device vdb from instance b585521b-0f65-4358-9830-a971e75a8705 from the live domain config.
Nov 13 20:56:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkDJiURB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:56:22 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f428e9f9-73e0-4be1-9970-9f9f1a192bda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:56:22 user nova-compute[75239]: No targets found.
Nov 13 20:56:22 user nova-compute[75239]: iSNS:
Nov 13 20:56:22 user nova-compute[75239]: No targets found.
Nov 13 20:56:22 user nova-compute[75239]: STATIC:
Nov 13 20:56:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3
Nov 13 20:56:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:56:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:56:22 user nova-compute[75239]: FIRMWARE:
Nov 13 20:56:22 user nova-compute[75239]: No targets found.
Nov 13 20:56:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:56:22 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:56:22 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88b8df2-c846-41da-85e4-5c7aabb37764]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[964e84d5-2c85-4ed4-8d0a-facaae6d2f57]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:56:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 (non-flash)
Nov 13 20:56:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d843b0550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[64195bec-65ea-45a2-b2b4-4d4dd19d3c86]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b93278-21c7-4119-a6e7-6e3a5b315e80]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d43aa6-68d9-4bac-9844-9fc38970f567]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8680eb2a-9850-433c-b5ba-76eaaf488075]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee4c8e4-f3c5-4692-9971-9c350f67730f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f925ea5-b941-447c-8586-1c64341d1ef7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3, portal: 172.16.0.220,3260]
Nov 13 20:56:22 user nova-compute[75239]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3, portal: 172.16.0.220,3260] successful.
Nov 13 20:56:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53546700-927a-4f21-8b84-a04692180ed3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[315dd7f6-35f2-420a-8d2e-22b332e62e48]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] <== disconnect_volume: return (270ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:56:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:56:23 user nova-compute[75239]: DEBUG nova.objects.instance [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lazy-loading 'flavor' on Instance uuid b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:56:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0e57e3e6-5dd1-44fd-81ba-ebfc579e6fcf tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:42 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:56:42 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=24.926063537597656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c0591fd1-adfd-4626-806a-a71f46c80400 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance b585521b-0f65-4358-9830-a971e75a8705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:56:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:44 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:56:44 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:56:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:56:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:56:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:56:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:56:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:52 user nova-compute[75239]: INFO nova.compute.manager [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Terminating instance
Nov 13 20:56:52 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-b83732ac-5f6e-4691-956a-8fc4e00066a7 req-4632fb56-17c7-4185-acb9-1d0165d22dca service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received event network-vif-unplugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b83732ac-5f6e-4691-956a-8fc4e00066a7 req-4632fb56-17c7-4185-acb9-1d0165d22dca service nova] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b83732ac-5f6e-4691-956a-8fc4e00066a7 req-4632fb56-17c7-4185-acb9-1d0165d22dca service nova] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b83732ac-5f6e-4691-956a-8fc4e00066a7 req-4632fb56-17c7-4185-acb9-1d0165d22dca service nova] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-b83732ac-5f6e-4691-956a-8fc4e00066a7 req-4632fb56-17c7-4185-acb9-1d0165d22dca service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] No waiting events found dispatching network-vif-unplugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG nova.compute.manager [req-b83732ac-5f6e-4691-956a-8fc4e00066a7 req-4632fb56-17c7-4185-acb9-1d0165d22dca service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received event network-vif-unplugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:56:52 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: b585521b-0f65-4358-9830-a971e75a8705] Instance destroyed successfully.
Nov 13 20:56:52 user nova-compute[75239]: DEBUG nova.objects.instance [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lazy-loading 'resources' on Instance uuid b585521b-0f65-4358-9830-a971e75a8705 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:53:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-250984596',display_name='tempest-TestServerVolumeAttachmentScenario-server-250984596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-250984596',id=40,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwy2KCSb3PNgaN5P9BXGlu9+iiJRQ8cMcJzSp3IgJiS4RRfgZdSJVjdmmabN4lqDjkpJDHRsxSD/aWJXhxpybIbkzJgP2ju6nYpLhY2N/ddTqtmfXTlOamAFdHMdPA2+w==',key_name='tempest-keypair-1634108910',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:53:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c6332c7b10e4ed6a36361561148126d',ramdisk_id='',reservation_id='r-u48s49ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-643324277',owner_user_name='tempest-TestServerVolumeAttachmentScenario-643324277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:53:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='71fa4b3479ba45158ec53220f0a50e82',uuid=b585521b-0f65-4358-9830-a971e75a8705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Converting VIF {"id": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "address": "fa:16:3e:6b:ca:c0", "network": {"id": "e5be7fbe-0a70-4093-b236-82274eb248eb", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-118446378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c6332c7b10e4ed6a36361561148126d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca3b5551-77", "ovs_interfaceid": "ca3b5551-7790-4f29-8f1c-17049e46bc86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=ca3b5551-7790-4f29-8f1c-17049e46bc86,network=Network(e5be7fbe-0a70-4093-b236-82274eb248eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3b5551-77') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG os_vif [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=ca3b5551-7790-4f29-8f1c-17049e46bc86,network=Network(e5be7fbe-0a70-4093-b236-82274eb248eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3b5551-77') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca3b5551-77, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc849a8a-1652-4cc3-bb66-61e9b1a7c0e7) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:52 user nova-compute[75239]: INFO os_vif [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ca:c0,bridge_name='br-int',has_traffic_filtering=True,id=ca3b5551-7790-4f29-8f1c-17049e46bc86,network=Network(e5be7fbe-0a70-4093-b236-82274eb248eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca3b5551-77')
Nov 13 20:56:52 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Deleting instance files /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705_del
Nov 13 20:56:52 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Deletion of /opt/stack/data/nova/instances/b585521b-0f65-4358-9830-a971e75a8705_del complete
Nov 13 20:56:53 user nova-compute[75239]: INFO nova.compute.manager [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] [instance: b585521b-0f65-4358-9830-a971e75a8705] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 20:56:53 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: b585521b-0f65-4358-9830-a971e75a8705] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: b585521b-0f65-4358-9830-a971e75a8705] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: b585521b-0f65-4358-9830-a971e75a8705] Skipping network cache update for instance because it is being deleted. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid c0591fd1-adfd-4626-806a-a71f46c80400 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: b585521b-0f65-4358-9830-a971e75a8705] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updating instance_info_cache with network_info: [{"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:56:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:56:54 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: b585521b-0f65-4358-9830-a971e75a8705] Took 0.99 seconds to deallocate network for instance.
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-aebc2c1c-87f9-4a98-aec0-f7e170926a3c req-1aea6681-254d-414b-8104-f5af9589faef service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received event network-changed-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-aebc2c1c-87f9-4a98-aec0-f7e170926a3c req-1aea6681-254d-414b-8104-f5af9589faef service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Refreshing instance network info cache due to event network-changed-e6a43c21-a34e-4c66-9a7c-65de4df750b2. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-aebc2c1c-87f9-4a98-aec0-f7e170926a3c req-1aea6681-254d-414b-8104-f5af9589faef service nova] Acquiring lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-aebc2c1c-87f9-4a98-aec0-f7e170926a3c req-1aea6681-254d-414b-8104-f5af9589faef service nova] Acquired lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-aebc2c1c-87f9-4a98-aec0-f7e170926a3c req-1aea6681-254d-414b-8104-f5af9589faef service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Refreshing network info cache for port e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:54 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Deleted allocations for instance b585521b-0f65-4358-9830-a971e75a8705
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ddf12412-9129-46bb-9245-7177819614cb tempest-TestServerVolumeAttachmentScenario-643324277 tempest-TestServerVolumeAttachmentScenario-643324277-project-member] Lock "b585521b-0f65-4358-9830-a971e75a8705" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-03d199db-2191-4326-8476-011292b7498f req-d59b7fc5-ea55-43c2-a490-d491be61d3b6 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received event network-vif-plugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-03d199db-2191-4326-8476-011292b7498f req-d59b7fc5-ea55-43c2-a490-d491be61d3b6 service nova] Acquiring lock "b585521b-0f65-4358-9830-a971e75a8705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-03d199db-2191-4326-8476-011292b7498f req-d59b7fc5-ea55-43c2-a490-d491be61d3b6 service nova] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-03d199db-2191-4326-8476-011292b7498f req-d59b7fc5-ea55-43c2-a490-d491be61d3b6 service nova] Lock "b585521b-0f65-4358-9830-a971e75a8705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-03d199db-2191-4326-8476-011292b7498f req-d59b7fc5-ea55-43c2-a490-d491be61d3b6 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] No waiting events found dispatching network-vif-plugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:56:54 user nova-compute[75239]: WARNING nova.compute.manager [req-03d199db-2191-4326-8476-011292b7498f req-d59b7fc5-ea55-43c2-a490-d491be61d3b6 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received unexpected event network-vif-plugged-ca3b5551-7790-4f29-8f1c-17049e46bc86 for instance with vm_state deleted and task_state None.
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.compute.manager [req-03d199db-2191-4326-8476-011292b7498f req-d59b7fc5-ea55-43c2-a490-d491be61d3b6 service nova] [instance: b585521b-0f65-4358-9830-a971e75a8705] Received event network-vif-deleted-ca3b5551-7790-4f29-8f1c-17049e46bc86 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-aebc2c1c-87f9-4a98-aec0-f7e170926a3c req-1aea6681-254d-414b-8104-f5af9589faef service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updated VIF entry in instance network info cache for port e6a43c21-a34e-4c66-9a7c-65de4df750b2. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-aebc2c1c-87f9-4a98-aec0-f7e170926a3c req-1aea6681-254d-414b-8104-f5af9589faef service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating instance_info_cache with network_info: [{"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-aebc2c1c-87f9-4a98-aec0-f7e170926a3c req-1aea6681-254d-414b-8104-f5af9589faef service nova] Releasing lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:56:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:55 user nova-compute[75239]: DEBUG nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:56:56 user nova-compute[75239]: INFO nova.compute.claims [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Claim successful on node user
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.network.neutron [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:56:56 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.policy [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6bc1e54d23824501a21398dd0410bba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '909c29838280436f85a2242f1c344eef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:56:56 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Creating image(s)
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "/opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "/opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "/opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.185s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk 1073741824" returned: 0 in 0.052s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:56 user nova-compute[75239]: INFO nova.compute.manager [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attaching volume 6f538201-29f4-486f-9ca1-46051716dd08 to /dev/vdb
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Successfully created port: 370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG os_brick.utils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2886499c-4028-493d-b1ca-365814a80378]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e587f427-8bbc-4986-a166-773da5fe23d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.197s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb20755-1abb-40f4-8b9c-5bcdc7867c65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca895f2-91ea-41ed-98dc-6e9b50bfbc7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:56:57 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[127e6b4c-ab1f-457d-a66e-096906b5c8c2]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG os_brick.utils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating existing volume attachment record: 07714880-1ea0-418d-b4ea-1c503b80d232 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Cannot resize image /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Ensure instance console log exists: /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Successfully updated port: 370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "refresh_cache-f847ff17-6194-42bb-862e-da3b64c15dea" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquired lock "refresh_cache-f847ff17-6194-42bb-862e-da3b64c15dea" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-e7e78c24-7bfe-4ac4-883f-2ceccaa0f202 req-6a53285f-bb39-4602-beb7-cbb2e6966350 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received event network-changed-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-e7e78c24-7bfe-4ac4-883f-2ceccaa0f202 req-6a53285f-bb39-4602-beb7-cbb2e6966350 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Refreshing instance network info cache due to event network-changed-370477ee-9538-4233-9fc1-2dea6b5813ac. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e7e78c24-7bfe-4ac4-883f-2ceccaa0f202 req-6a53285f-bb39-4602-beb7-cbb2e6966350 service nova] Acquiring lock "refresh_cache-f847ff17-6194-42bb-862e-da3b64c15dea" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Updating instance_info_cache with network_info: [{"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Releasing lock "refresh_cache-f847ff17-6194-42bb-862e-da3b64c15dea" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Instance network_info: |[{"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e7e78c24-7bfe-4ac4-883f-2ceccaa0f202 req-6a53285f-bb39-4602-beb7-cbb2e6966350 service nova] Acquired lock "refresh_cache-f847ff17-6194-42bb-862e-da3b64c15dea" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.network.neutron [req-e7e78c24-7bfe-4ac4-883f-2ceccaa0f202 req-6a53285f-bb39-4602-beb7-cbb2e6966350 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Refreshing network info cache for port 370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Start _get_guest_xml network_info=[{"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:56:58 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:56:58 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1890742248',display_name='tempest-VolumesSnapshotTestJSON-instance-1890742248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1890742248',id=45,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv7DEkWQNUg+u3HwCY5YfpwAB/ohf3vsw7JlmovSW1moQR3/zDY/9gkVTRaDE90Myg0H24PljucuZ4TNu6H0MIbFj/sh4htpJfaFulV710Xht9iVDUeLCOak0pbliIWBQ==',key_name='tempest-keypair-807672837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909c29838280436f85a2242f1c344eef',ramdisk_id='',reservation_id='r-iau1xxrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-77894400',owner_user_name='tempest-VolumesSnapshotTestJSON-77894400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bc1e54d23824501a21398dd0410bba1',uuid=f847ff17-6194-42bb-862e-da3b64c15dea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converting VIF {"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:75:e5,bridge_name='br-int',has_traffic_filtering=True,id=370477ee-9538-4233-9fc1-2dea6b5813ac,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370477ee-95') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.objects.instance [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'pci_devices' on Instance uuid f847ff17-6194-42bb-862e-da3b64c15dea {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:56:58 user nova-compute[75239]:   <uuid>f847ff17-6194-42bb-862e-da3b64c15dea</uuid>
Nov 13 20:56:58 user nova-compute[75239]:   <name>instance-0000002d</name>
Nov 13 20:56:58 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:56:58 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:56:58 user nova-compute[75239]:   <metadata>
Nov 13 20:56:58 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:56:58 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:56:58 user nova-compute[75239]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1890742248</nova:name>
Nov 13 20:56:58 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:56:58</nova:creationTime>
Nov 13 20:56:58 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:56:58 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:56:58 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:56:58 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:56:58 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:56:58 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:56:58 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:56:58 user nova-compute[75239]:       <nova:owner>
Nov 13 20:56:58 user nova-compute[75239]:         <nova:user uuid="6bc1e54d23824501a21398dd0410bba1">tempest-VolumesSnapshotTestJSON-77894400-project-member</nova:user>
Nov 13 20:56:58 user nova-compute[75239]:         <nova:project uuid="909c29838280436f85a2242f1c344eef">tempest-VolumesSnapshotTestJSON-77894400</nova:project>
Nov 13 20:56:58 user nova-compute[75239]:       </nova:owner>
Nov 13 20:56:58 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:56:58 user nova-compute[75239]:       <nova:ports>
Nov 13 20:56:58 user nova-compute[75239]:         <nova:port uuid="370477ee-9538-4233-9fc1-2dea6b5813ac">
Nov 13 20:56:58 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 20:56:58 user nova-compute[75239]:         </nova:port>
Nov 13 20:56:58 user nova-compute[75239]:       </nova:ports>
Nov 13 20:56:58 user nova-compute[75239]:     </nova:instance>
Nov 13 20:56:58 user nova-compute[75239]:   </metadata>
Nov 13 20:56:58 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:56:58 user nova-compute[75239]:     <system>
Nov 13 20:56:58 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:56:58 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:56:58 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:56:58 user nova-compute[75239]:       <entry name="serial">f847ff17-6194-42bb-862e-da3b64c15dea</entry>
Nov 13 20:56:58 user nova-compute[75239]:       <entry name="uuid">f847ff17-6194-42bb-862e-da3b64c15dea</entry>
Nov 13 20:56:58 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:56:58 user nova-compute[75239]:     </system>
Nov 13 20:56:58 user nova-compute[75239]:   </sysinfo>
Nov 13 20:56:58 user nova-compute[75239]:   <os>
Nov 13 20:56:58 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:56:58 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:56:58 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:56:58 user nova-compute[75239]:   </os>
Nov 13 20:56:58 user nova-compute[75239]:   <features>
Nov 13 20:56:58 user nova-compute[75239]:     <acpi/>
Nov 13 20:56:58 user nova-compute[75239]:     <apic/>
Nov 13 20:56:58 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:56:58 user nova-compute[75239]:   </features>
Nov 13 20:56:58 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:56:58 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:56:58 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:56:58 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:56:58 user nova-compute[75239]:   </clock>
Nov 13 20:56:58 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:56:58 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:56:58 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:56:58 user nova-compute[75239]:   </cpu>
Nov 13 20:56:58 user nova-compute[75239]:   <devices>
Nov 13 20:56:58 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:56:58 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:56:58 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk"/>
Nov 13 20:56:58 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:56:58 user nova-compute[75239]:     </disk>
Nov 13 20:56:58 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:56:58 user nova-compute[75239]:       <mac address="fa:16:3e:2c:75:e5"/>
Nov 13 20:56:58 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:56:58 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:56:58 user nova-compute[75239]:       <target dev="tap370477ee-95"/>
Nov 13 20:56:58 user nova-compute[75239]:     </interface>
Nov 13 20:56:58 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:56:58 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/console.log" append="off"/>
Nov 13 20:56:58 user nova-compute[75239]:     </serial>
Nov 13 20:56:58 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:56:58 user nova-compute[75239]:     <video>
Nov 13 20:56:58 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:56:58 user nova-compute[75239]:     </video>
Nov 13 20:56:58 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:56:58 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:56:58 user nova-compute[75239]:     </rng>
Nov 13 20:56:58 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:56:58 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:56:58 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:56:58 user nova-compute[75239]:     </memballoon>
Nov 13 20:56:58 user nova-compute[75239]:   </devices>
Nov 13 20:56:58 user nova-compute[75239]: </domain>
Nov 13 20:56:58 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1890742248',display_name='tempest-VolumesSnapshotTestJSON-instance-1890742248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1890742248',id=45,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv7DEkWQNUg+u3HwCY5YfpwAB/ohf3vsw7JlmovSW1moQR3/zDY/9gkVTRaDE90Myg0H24PljucuZ4TNu6H0MIbFj/sh4htpJfaFulV710Xht9iVDUeLCOak0pbliIWBQ==',key_name='tempest-keypair-807672837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='909c29838280436f85a2242f1c344eef',ramdisk_id='',reservation_id='r-iau1xxrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-77894400',owner_user_name='tempest-VolumesSnapshotTestJSON-77894400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:56:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bc1e54d23824501a21398dd0410bba1',uuid=f847ff17-6194-42bb-862e-da3b64c15dea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converting VIF {"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:75:e5,bridge_name='br-int',has_traffic_filtering=True,id=370477ee-9538-4233-9fc1-2dea6b5813ac,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370477ee-95') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG os_vif [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:75:e5,bridge_name='br-int',has_traffic_filtering=True,id=370477ee-9538-4233-9fc1-2dea6b5813ac,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370477ee-95') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'caeb720f-5102-5e2a-85eb-b0ce23af298d', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap370477ee-95, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap370477ee-95, col_values=(('qos', UUID('02d39c4d-a2bd-4516-b021-2dc8d5858d1d')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap370477ee-95, col_values=(('external_ids', {'iface-id': '370477ee-9538-4233-9fc1-2dea6b5813ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:75:e5', 'vm-uuid': 'f847ff17-6194-42bb-862e-da3b64c15dea'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:58 user nova-compute[75239]: INFO os_vif [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:75:e5,bridge_name='br-int',has_traffic_filtering=True,id=370477ee-9538-4233-9fc1-2dea6b5813ac,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370477ee-95')
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No VIF found with MAC fa:16:3e:2c:75:e5, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.network.neutron [req-e7e78c24-7bfe-4ac4-883f-2ceccaa0f202 req-6a53285f-bb39-4602-beb7-cbb2e6966350 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Updated VIF entry in instance network info cache for port 370477ee-9538-4233-9fc1-2dea6b5813ac. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG nova.network.neutron [req-e7e78c24-7bfe-4ac4-883f-2ceccaa0f202 req-6a53285f-bb39-4602-beb7-cbb2e6966350 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Updating instance_info_cache with network_info: [{"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e7e78c24-7bfe-4ac4-883f-2ceccaa0f202 req-6a53285f-bb39-4602-beb7-cbb2e6966350 service nova] Releasing lock "refresh_cache-f847ff17-6194-42bb-862e-da3b64c15dea" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:56:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:56:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-c3ff85d1-500e-42d7-98d0-f4e3ec0bcee9 req-13e27b36-5bc1-4ac8-a3d7-913acc51944b service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received event network-vif-plugged-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:56:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c3ff85d1-500e-42d7-98d0-f4e3ec0bcee9 req-13e27b36-5bc1-4ac8-a3d7-913acc51944b service nova] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:56:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c3ff85d1-500e-42d7-98d0-f4e3ec0bcee9 req-13e27b36-5bc1-4ac8-a3d7-913acc51944b service nova] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:56:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c3ff85d1-500e-42d7-98d0-f4e3ec0bcee9 req-13e27b36-5bc1-4ac8-a3d7-913acc51944b service nova] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:56:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-c3ff85d1-500e-42d7-98d0-f4e3ec0bcee9 req-13e27b36-5bc1-4ac8-a3d7-913acc51944b service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] No waiting events found dispatching network-vif-plugged-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:56:59 user nova-compute[75239]: WARNING nova.compute.manager [req-c3ff85d1-500e-42d7-98d0-f4e3ec0bcee9 req-13e27b36-5bc1-4ac8-a3d7-913acc51944b service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received unexpected event network-vif-plugged-370477ee-9538-4233-9fc1-2dea6b5813ac for instance with vm_state building and task_state spawning.
Nov 13 20:57:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:00 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrRZbyLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:57:01 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:57:01 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:57:01 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e65d19-b625-409b-85b9-9b44be220055]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:57:01 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[474c2ed3-d7ac-4e5d-8cfa-3ef3214db539]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08] added
Nov 13 20:57:01 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fad732-2774-42b6-841d-874ab6cc144b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc7ce4b-6c8c-460b-b6ff-1f686f3ddc77]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrRZbyLt {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrRZbyLt" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d419da2-0ea9-482e-892a-4c33cf084d01]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrRZbyLt'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b443cc8-c51d-4809-9981-14aea26bc8be]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2265fa5c-e421-471c-93f2-62512f635142]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:57:01 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:57:01 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:57:01 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 20:57:01 user nova-compute[75239]: 
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7daf92-0c3c-404e-a326-e283dea3950f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08, portal: 172.16.0.220,3260]
Nov 13 20:57:01 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08, portal: 172.16.0.220,3260] successful.
Nov 13 20:57:01 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f4a34f-4c62-4d69-9b07-3768b7b876d9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3b182d-a0f2-4e64-99d5-8bed348095cb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 (non-flash)
Nov 13 20:57:01 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 (non-flash)
Nov 13 20:57:01 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e7c70c-149e-4c03-b0f6-a12b30e05916]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrRZbyLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:57:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Instance spawned successfully.
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:57:01 user nova-compute[75239]: INFO nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-c9abac96-d890-4ae2-a938-8c7b29f3c030 req-2b86e07c-b126-43d0-a56e-b73467e25ccb service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received event network-vif-plugged-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c9abac96-d890-4ae2-a938-8c7b29f3c030 req-2b86e07c-b126-43d0-a56e-b73467e25ccb service nova] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c9abac96-d890-4ae2-a938-8c7b29f3c030 req-2b86e07c-b126-43d0-a56e-b73467e25ccb service nova] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c9abac96-d890-4ae2-a938-8c7b29f3c030 req-2b86e07c-b126-43d0-a56e-b73467e25ccb service nova] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:57:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-c9abac96-d890-4ae2-a938-8c7b29f3c030 req-2b86e07c-b126-43d0-a56e-b73467e25ccb service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] No waiting events found dispatching network-vif-plugged-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:57:01 user nova-compute[75239]: WARNING nova.compute.manager [req-c9abac96-d890-4ae2-a938-8c7b29f3c030 req-2b86e07c-b126-43d0-a56e-b73467e25ccb service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received unexpected event network-vif-plugged-370477ee-9538-4233-9fc1-2dea6b5813ac for instance with vm_state building and task_state spawning.
Nov 13 20:57:01 user nova-compute[75239]: INFO nova.compute.manager [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Took 5.88 seconds to build instance.
Nov 13 20:57:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-82fc742b-d07c-4446-a58d-08211e75ce64 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.069s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:57:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:57:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23130333936643135', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:57:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130333936643135', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:57:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:57:02 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:57:02 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:57:02 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:57:02 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:57:02 user nova-compute[75239]:   <serial>6f538201-29f4-486f-9ca1-46051716dd08</serial>
Nov 13 20:57:02 user nova-compute[75239]: </disk>
Nov 13 20:57:02 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:57:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:57:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:57:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No VIF found with MAC fa:16:3e:01:c9:f0, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:57:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f08237b-2286-455f-a0b6-c08d9e73f36a tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.145s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:57:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:57:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:57:10 user nova-compute[75239]: INFO nova.compute.manager [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Detaching volume 6f538201-29f4-486f-9ca1-46051716dd08
Nov 13 20:57:10 user nova-compute[75239]: INFO nova.virt.block_device [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attempting to driver detach volume 6f538201-29f4-486f-9ca1-46051716dd08 from mountpoint /dev/vdb
Nov 13 20:57:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Attempting to detach device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:57:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:57:10 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:57:10 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:57:10 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:57:10 user nova-compute[75239]:   <serial>6f538201-29f4-486f-9ca1-46051716dd08</serial>
Nov 13 20:57:10 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:57:10 user nova-compute[75239]: </disk>
Nov 13 20:57:10 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:57:10 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully detached device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the persistent domain config.
Nov 13 20:57:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:57:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:57:10 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:57:10 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:57:10 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:57:10 user nova-compute[75239]:   <serial>6f538201-29f4-486f-9ca1-46051716dd08</serial>
Nov 13 20:57:10 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:57:10 user nova-compute[75239]: </disk>
Nov 13 20:57:10 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:57:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:57:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:30 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c is timed out.
Nov 13 20:57:30 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully detached device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the live domain config.
Nov 13 20:57:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrRZbyLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:57:31 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164db5e-2fea-4907-89f7-6520879740fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:57:31 user nova-compute[75239]: No targets found.
Nov 13 20:57:31 user nova-compute[75239]: iSNS:
Nov 13 20:57:31 user nova-compute[75239]: No targets found.
Nov 13 20:57:31 user nova-compute[75239]: STATIC:
Nov 13 20:57:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08
Nov 13 20:57:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:57:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:57:31 user nova-compute[75239]: FIRMWARE:
Nov 13 20:57:31 user nova-compute[75239]: No targets found.
Nov 13 20:57:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:57:31 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:57:31 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[87979601-779d-4618-acb3-5e16b9d27e87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fd7984-f0b4-4f89-8d33-1b3fcba63afa]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 (non-flash)
Nov 13 20:57:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 (non-flash)
Nov 13 20:57:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d603e3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d0051d-4fe1-4256-bdf5-9d9679ece8ea]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac3b318-9258-4478-b757-2fcd9fbab9e2]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdc257b-be0c-43d4-a40e-b140867fea17]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f145ae29-a42f-4499-9f84-381a98e19422]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edf0c1a-6030-4365-aa4b-4a43a40f2c62]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[709ef6de-8939-4251-96f8-76c5f4162a45]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08, portal: 172.16.0.220,3260]
Nov 13 20:57:31 user nova-compute[75239]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08, portal: 172.16.0.220,3260] successful.
Nov 13 20:57:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f538201-29f4-486f-9ca1-46051716dd08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd1dc5f-cc7d-42a6-a564-2437afcb08ff]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== disconnect_volume: return (314ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:57:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:57:32 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:57:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a54e9141-329b-47ed-8b6e-170c14374b3b tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:57:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:57:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:57:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:57:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8514MB free_disk=24.922866821289062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c0591fd1-adfd-4626-806a-a71f46c80400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f847ff17-6194-42bb-862e-da3b64c15dea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:57:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:57:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:57:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:54 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:57:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:57:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:57:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:57:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:57:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating instance_info_cache with network_info: [{"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:57:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:57:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:57:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:57:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-bff1e7f7-f417-4c5a-8040-dc14d6433d18 req-acd4d969-5f45-404e-bc14-26b48b58738d service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received event network-changed-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:57:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-bff1e7f7-f417-4c5a-8040-dc14d6433d18 req-acd4d969-5f45-404e-bc14-26b48b58738d service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Refreshing instance network info cache due to event network-changed-a9b5592d-d5d8-4e44-98f5-40ee4537554d. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:57:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff1e7f7-f417-4c5a-8040-dc14d6433d18 req-acd4d969-5f45-404e-bc14-26b48b58738d service nova] Acquiring lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:57:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff1e7f7-f417-4c5a-8040-dc14d6433d18 req-acd4d969-5f45-404e-bc14-26b48b58738d service nova] Acquired lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:57:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-bff1e7f7-f417-4c5a-8040-dc14d6433d18 req-acd4d969-5f45-404e-bc14-26b48b58738d service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Refreshing network info cache for port a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:57:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-bff1e7f7-f417-4c5a-8040-dc14d6433d18 req-acd4d969-5f45-404e-bc14-26b48b58738d service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Updated VIF entry in instance network info cache for port a9b5592d-d5d8-4e44-98f5-40ee4537554d. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:57:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-bff1e7f7-f417-4c5a-8040-dc14d6433d18 req-acd4d969-5f45-404e-bc14-26b48b58738d service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Updating instance_info_cache with network_info: [{"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:57:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-bff1e7f7-f417-4c5a-8040-dc14d6433d18 req-acd4d969-5f45-404e-bc14-26b48b58738d service nova] Releasing lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:58:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:00 user nova-compute[75239]: DEBUG nova.objects.instance [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'flavor' on Instance uuid 8cd0c72d-be0b-4ada-8149-b43f3bd52692 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:01 user nova-compute[75239]: INFO nova.compute.manager [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Attaching volume c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a to /dev/vdb
Nov 13 20:58:01 user nova-compute[75239]: DEBUG os_brick.utils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b5342e-bb05-4ffb-8567-0ace7ac457c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a0493b-c957-4b68-9d8a-c364c25e11a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd0ea8c-d9f9-4f5b-853c-dbb930f09d90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d54db38-0454-4c41-bd5d-7c3ba9100abb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:58:01 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:58:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd99e709-54ee-4839-83ee-2b19e8dfbf46]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG os_brick.utils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:01 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Updating existing volume attachment record: cb23de51-e154-4ce3-8b6e-26eb4f89e232 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:02 user nova-compute[75239]: INFO nova.compute.manager [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attaching volume 4d3f7563-0b00-46c2-bf29-76670694b875 to /dev/vdb
Nov 13 20:58:02 user nova-compute[75239]: DEBUG os_brick.utils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[22723dda-f806-43e2-af04-7fcf14f3c00b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3289c400-2a3e-4792-ae56-77193aa0b8fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb97730-7d54-44a3-b706-d4d8198b5840]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a24144-1697-4868-8d93-0de5e1eb6822]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:58:02 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:58:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f576db6f-bb73-4bda-8a0f-04d047c58c74]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG os_brick.utils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:02 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating existing volume attachment record: ceb62726-077e-4192-8663-5883599e14e9 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:58:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyIkeMQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:05 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:05 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:05 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35869d3-c12e-41c8-9d38-04ca87635777]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:58:05 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c51e58-5b35-463e-b7fd-623ced8e14b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a] added
Nov 13 20:58:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b464a9f-d3d1-43cd-925f-ae856ae180d2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b17c3b0-d4e2-4469-b414-763b2cd36d59]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyIkeMQb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oyIkeMQb" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f8d5a3-712b-4478-b2a1-c8e4ea5b9a3a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oyIkeMQb'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[02642de6-4626-42f9-ab12-f0140e4f4341]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d00c39b-c6b8-4fa9-8031-dfb59be7a058]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:58:05 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 20:58:05 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:05 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 20:58:05 user nova-compute[75239]: 
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[80de3ad2-9b83-4dab-b7dc-42498e6c5cf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a, portal: 172.16.0.220,3260]
Nov 13 20:58:05 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a, portal: 172.16.0.220,3260] successful.
Nov 13 20:58:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aae00fa-ceb6-424d-ac23-69fc1036e8bb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa97add-171f-4e07-b2c3-862c75374500]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:05 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ee416-984c-4a9b-b6d2-125fcc3f150c]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:05 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:58:06 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:58:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyIkeMQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:58:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23865343334373338', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865343334373338', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:58:06 user nova-compute[75239]: DEBUG nova.objects.instance [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'flavor' on Instance uuid 8cd0c72d-be0b-4ada-8149-b43f3bd52692 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:58:06 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:06 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:58:06 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:58:06 user nova-compute[75239]:   <serial>c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a</serial>
Nov 13 20:58:06 user nova-compute[75239]: </disk>
Nov 13 20:58:06 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzqBdVyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:07 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:07 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:07 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcd4bc3-f81d-4d47-88c9-fba47958acf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:58:07 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3a5caa-c261-4d54-aac3-af02ed0d0bbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875] added
Nov 13 20:58:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c5b714-2621-4c14-9d56-63199a560a52]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ae800-a7c0-474c-9463-7a93597a1345]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzqBdVyc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OzqBdVyc" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ead543-aafa-4e24-98be-afebe6f2e68f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OzqBdVyc'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78788d4d-669a-4a7a-a25a-ad7888c49418]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No VIF found with MAC fa:16:3e:f6:0c:36, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb050903-4a4f-4c62-b007-ca17adcbccd1]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0728c8-2879-4a25-b296-f7ccc6dd9173]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875, portal: 172.16.0.220,3260]
Nov 13 20:58:07 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875, portal: 172.16.0.220,3260] successful.
Nov 13 20:58:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d2df9c-6228-435b-933e-78bcb5d94a22]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e2e781-965f-4835-9402-06dc58b11305]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:07 user nova-compute[75239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:07 user nova-compute[75239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-faf21624-791a-4a05-bb39-43f47882f41a tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.296s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbadc2e-db18-41b8-85a8-57aea1d42449]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzqBdVyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:08 user nova-compute[75239]: INFO nova.compute.manager [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Detaching volume c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a
Nov 13 20:58:08 user nova-compute[75239]: INFO nova.virt.block_device [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Attempting to driver detach volume c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a from mountpoint /dev/vdb
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Attempting to detach device vdb from instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692 from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:58:08 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:08 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:58:08 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:58:08 user nova-compute[75239]:   <serial>c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a</serial>
Nov 13 20:58:08 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:58:08 user nova-compute[75239]: </disk>
Nov 13 20:58:08 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:58:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully detached device vdb from instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692 from the persistent domain config.
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692 from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:58:08 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:08 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:58:08 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:58:08 user nova-compute[75239]:   <serial>c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a</serial>
Nov 13 20:58:08 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:58:08 user nova-compute[75239]: </disk>
Nov 13 20:58:08 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23463626433363034', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463626433363034', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.objects.instance [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:58:08 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:08 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:58:08 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:58:08 user nova-compute[75239]:   <serial>4d3f7563-0b00-46c2-bf29-76670694b875</serial>
Nov 13 20:58:08 user nova-compute[75239]: </disk>
Nov 13 20:58:08 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692 {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "87359099-25a3-4c68-8242-e611db1bcc77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "87359099-25a3-4c68-8242-e611db1bcc77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:58:08 user nova-compute[75239]: INFO nova.compute.claims [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Claim successful on node user
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No VIF found with MAC fa:16:3e:01:c9:f0, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:58:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:58:09 user nova-compute[75239]: DEBUG nova.network.neutron [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:58:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:58:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:58:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-89845929-e880-4e44-a6f2-966a9782bae7 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.405s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:09 user nova-compute[75239]: DEBUG nova.policy [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e1458f29bb94b0abd4b75ac943fb531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc5530ef3c040dd82883043dabc4c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:58:09 user nova-compute[75239]: INFO nova.virt.block_device [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Booting with volume snapshot 3c61e249-62af-492f-834e-dfcfeec539b6 at /dev/vda
Nov 13 20:58:09 user nova-compute[75239]: DEBUG nova.network.neutron [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Successfully created port: 4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Successfully updated port: 4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "refresh_cache-87359099-25a3-4c68-8242-e611db1bcc77" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquired lock "refresh_cache-87359099-25a3-4c68-8242-e611db1bcc77" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-68acc6fc-3abc-449e-b219-2d6642edd529 req-ff0bf46c-f4f7-4567-9488-7bbedaeafbc8 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received event network-changed-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-68acc6fc-3abc-449e-b219-2d6642edd529 req-ff0bf46c-f4f7-4567-9488-7bbedaeafbc8 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Refreshing instance network info cache due to event network-changed-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-68acc6fc-3abc-449e-b219-2d6642edd529 req-ff0bf46c-f4f7-4567-9488-7bbedaeafbc8 service nova] Acquiring lock "refresh_cache-87359099-25a3-4c68-8242-e611db1bcc77" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:10 user nova-compute[75239]: INFO nova.compute.manager [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Detaching volume 4d3f7563-0b00-46c2-bf29-76670694b875
Nov 13 20:58:10 user nova-compute[75239]: INFO nova.virt.block_device [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attempting to driver detach volume 4d3f7563-0b00-46c2-bf29-76670694b875 from mountpoint /dev/vdb
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Attempting to detach device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:58:10 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:10 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:58:10 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:58:10 user nova-compute[75239]:   <serial>4d3f7563-0b00-46c2-bf29-76670694b875</serial>
Nov 13 20:58:10 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:58:10 user nova-compute[75239]: </disk>
Nov 13 20:58:10 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.network.neutron [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Updating instance_info_cache with network_info: [{"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:58:10 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully detached device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the persistent domain config.
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:58:10 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:10 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:58:10 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:58:10 user nova-compute[75239]:   <serial>4d3f7563-0b00-46c2-bf29-76670694b875</serial>
Nov 13 20:58:10 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:58:10 user nova-compute[75239]: </disk>
Nov 13 20:58:10 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Releasing lock "refresh_cache-87359099-25a3-4c68-8242-e611db1bcc77" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Instance network_info: |[{"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-68acc6fc-3abc-449e-b219-2d6642edd529 req-ff0bf46c-f4f7-4567-9488-7bbedaeafbc8 service nova] Acquired lock "refresh_cache-87359099-25a3-4c68-8242-e611db1bcc77" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:58:10 user nova-compute[75239]: DEBUG nova.network.neutron [req-68acc6fc-3abc-449e-b219-2d6642edd529 req-ff0bf46c-f4f7-4567-9488-7bbedaeafbc8 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Refreshing network info cache for port 4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:58:11 user nova-compute[75239]: DEBUG nova.network.neutron [req-68acc6fc-3abc-449e-b219-2d6642edd529 req-ff0bf46c-f4f7-4567-9488-7bbedaeafbc8 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Updated VIF entry in instance network info cache for port 4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:58:11 user nova-compute[75239]: DEBUG nova.network.neutron [req-68acc6fc-3abc-449e-b219-2d6642edd529 req-ff0bf46c-f4f7-4567-9488-7bbedaeafbc8 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Updating instance_info_cache with network_info: [{"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:58:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-68acc6fc-3abc-449e-b219-2d6642edd529 req-ff0bf46c-f4f7-4567-9488-7bbedaeafbc8 service nova] Releasing lock "refresh_cache-87359099-25a3-4c68-8242-e611db1bcc77" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:58:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:58:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG os_brick.utils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b67b96-e0ac-4c92-bc08-0aa601fa8caa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd9aa57-c963-4c34-968a-adf2fa7195fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[115f1841-5186-4f3a-8d35-c12b51b78808]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8e659c-7ad0-49b1-9716-728016beca6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:58:14 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:58:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f5447b-05e4-4586-9ef2-c5cdf203848c]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG os_brick.utils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:14 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Updating existing volume attachment record: 23af2658-4d56-4446-9eed-b037f302d564 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:58:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:58:19 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Creating image(s)
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Ensure instance console log exists: /opt/stack/data/nova/instances/87359099-25a3-4c68-8242-e611db1bcc77/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Start _get_guest_xml network_info=[{"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '23af2658-4d56-4446-9eed-b037f302d564', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEKyMieX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '87359099-25a3-4c68-8242-e611db1bcc77', 'attached_at': '', 'detached_at': '', 'volume_id': '9a48c135-6bee-42b1-85f3-90fa5bb313ee', 'serial': '9a48c135-6bee-42b1-85f3-90fa5bb313ee'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:58:19 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:58:19 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEKyMieX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:19 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:19 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:19 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dcceba-05a2-4997-bd4e-0e593ddaed7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:58:19 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdec8c4-2d15-482d-8978-64bb4965c7f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee] added
Nov 13 20:58:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[743b5742-0d2a-401a-b0b5-cc7428b0d2e7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92113bb-350c-48af-9d26-2328d473e1b7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEKyMieX {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JEKyMieX" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7619980-c9fc-49b4-867d-9dfb18fb6a8c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JEKyMieX'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c455ca-6080-4b73-9aca-6b73c550ce5d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73aa5c4-cb23-4d18-996f-9826a7829306]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:19 user nova-compute[75239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:19 user nova-compute[75239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbd8d33-ffe3-4519-907b-64d0fc61bc2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee, portal: 172.16.0.220,3260]
Nov 13 20:58:19 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee, portal: 172.16.0.220,3260] successful.
Nov 13 20:58:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f72d890-7e2e-47b4-81aa-ad7b3e7da719]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0de6875-b8d3-4590-b5e0-729047cb3e22]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:19 user nova-compute[75239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:19 user nova-compute[75239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:19 user nova-compute[75239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:19 user nova-compute[75239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:19 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b793a015-55e9-48c5-8d9c-41664cd6431f]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEKyMieX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23664336432643239', 'path': '/dev/sdd'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664336432643239', 'path': '/dev/sdd'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-620633066',display_name='tempest-TestVolumeBootPattern-server-620633066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-620633066',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-dsaukclb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:58:09Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=87359099-25a3-4c68-8242-e611db1bcc77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:af:65,bridge_name='br-int',has_traffic_filtering=True,id=4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f883aa8-9e') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.objects.instance [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'pci_devices' on Instance uuid 87359099-25a3-4c68-8242-e611db1bcc77 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:58:20 user nova-compute[75239]:   <uuid>87359099-25a3-4c68-8242-e611db1bcc77</uuid>
Nov 13 20:58:20 user nova-compute[75239]:   <name>instance-0000002e</name>
Nov 13 20:58:20 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:58:20 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:58:20 user nova-compute[75239]:   <metadata>
Nov 13 20:58:20 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:58:20 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:58:20 user nova-compute[75239]:       <nova:name>tempest-TestVolumeBootPattern-server-620633066</nova:name>
Nov 13 20:58:20 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:58:19</nova:creationTime>
Nov 13 20:58:20 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:58:20 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:58:20 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:58:20 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:58:20 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:58:20 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:58:20 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:58:20 user nova-compute[75239]:       <nova:owner>
Nov 13 20:58:20 user nova-compute[75239]:         <nova:user uuid="7e1458f29bb94b0abd4b75ac943fb531">tempest-TestVolumeBootPattern-1828724263-project-member</nova:user>
Nov 13 20:58:20 user nova-compute[75239]:         <nova:project uuid="fbc5530ef3c040dd82883043dabc4c7d">tempest-TestVolumeBootPattern-1828724263</nova:project>
Nov 13 20:58:20 user nova-compute[75239]:       </nova:owner>
Nov 13 20:58:20 user nova-compute[75239]:       <nova:ports>
Nov 13 20:58:20 user nova-compute[75239]:         <nova:port uuid="4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5">
Nov 13 20:58:20 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 20:58:20 user nova-compute[75239]:         </nova:port>
Nov 13 20:58:20 user nova-compute[75239]:       </nova:ports>
Nov 13 20:58:20 user nova-compute[75239]:     </nova:instance>
Nov 13 20:58:20 user nova-compute[75239]:   </metadata>
Nov 13 20:58:20 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:58:20 user nova-compute[75239]:     <system>
Nov 13 20:58:20 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:58:20 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:58:20 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:58:20 user nova-compute[75239]:       <entry name="serial">87359099-25a3-4c68-8242-e611db1bcc77</entry>
Nov 13 20:58:20 user nova-compute[75239]:       <entry name="uuid">87359099-25a3-4c68-8242-e611db1bcc77</entry>
Nov 13 20:58:20 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:58:20 user nova-compute[75239]:     </system>
Nov 13 20:58:20 user nova-compute[75239]:   </sysinfo>
Nov 13 20:58:20 user nova-compute[75239]:   <os>
Nov 13 20:58:20 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:58:20 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:58:20 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:58:20 user nova-compute[75239]:   </os>
Nov 13 20:58:20 user nova-compute[75239]:   <features>
Nov 13 20:58:20 user nova-compute[75239]:     <acpi/>
Nov 13 20:58:20 user nova-compute[75239]:     <apic/>
Nov 13 20:58:20 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:58:20 user nova-compute[75239]:   </features>
Nov 13 20:58:20 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:58:20 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:58:20 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:58:20 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:58:20 user nova-compute[75239]:   </clock>
Nov 13 20:58:20 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:58:20 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:58:20 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:58:20 user nova-compute[75239]:   </cpu>
Nov 13 20:58:20 user nova-compute[75239]:   <devices>
Nov 13 20:58:20 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 20:58:20 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:20 user nova-compute[75239]:       <source dev="/dev/sdd"/>
Nov 13 20:58:20 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:58:20 user nova-compute[75239]:       <serial>9a48c135-6bee-42b1-85f3-90fa5bb313ee</serial>
Nov 13 20:58:20 user nova-compute[75239]:     </disk>
Nov 13 20:58:20 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:58:20 user nova-compute[75239]:       <mac address="fa:16:3e:2a:af:65"/>
Nov 13 20:58:20 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:58:20 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:58:20 user nova-compute[75239]:       <target dev="tap4f883aa8-9e"/>
Nov 13 20:58:20 user nova-compute[75239]:     </interface>
Nov 13 20:58:20 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:58:20 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/87359099-25a3-4c68-8242-e611db1bcc77/console.log" append="off"/>
Nov 13 20:58:20 user nova-compute[75239]:     </serial>
Nov 13 20:58:20 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:58:20 user nova-compute[75239]:     <video>
Nov 13 20:58:20 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:58:20 user nova-compute[75239]:     </video>
Nov 13 20:58:20 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:58:20 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:58:20 user nova-compute[75239]:     </rng>
Nov 13 20:58:20 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:58:20 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:58:20 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:58:20 user nova-compute[75239]:     </memballoon>
Nov 13 20:58:20 user nova-compute[75239]:   </devices>
Nov 13 20:58:20 user nova-compute[75239]: </domain>
Nov 13 20:58:20 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-620633066',display_name='tempest-TestVolumeBootPattern-server-620633066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-620633066',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-dsaukclb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:58:09Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=87359099-25a3-4c68-8242-e611db1bcc77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:af:65,bridge_name='br-int',has_traffic_filtering=True,id=4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f883aa8-9e') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG os_vif [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:af:65,bridge_name='br-int',has_traffic_filtering=True,id=4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f883aa8-9e') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5defea21-399c-52e2-9d9a-7744f81c5133', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f883aa8-9e, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f883aa8-9e, col_values=(('qos', UUID('a82e675a-366c-4106-86c3-49e0bc38123d')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f883aa8-9e, col_values=(('external_ids', {'iface-id': '4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:af:65', 'vm-uuid': '87359099-25a3-4c68-8242-e611db1bcc77'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:20 user nova-compute[75239]: INFO os_vif [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:af:65,bridge_name='br-int',has_traffic_filtering=True,id=4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f883aa8-9e')
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:58:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No VIF found with MAC fa:16:3e:2a:af:65, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:58:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-f5f992b6-e5e0-415d-afac-727a42650af5 req-7c4e7896-4cc8-450f-8062-2f61033dd847 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received event network-vif-plugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:58:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f5f992b6-e5e0-415d-afac-727a42650af5 req-7c4e7896-4cc8-450f-8062-2f61033dd847 service nova] Acquiring lock "87359099-25a3-4c68-8242-e611db1bcc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f5f992b6-e5e0-415d-afac-727a42650af5 req-7c4e7896-4cc8-450f-8062-2f61033dd847 service nova] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-f5f992b6-e5e0-415d-afac-727a42650af5 req-7c4e7896-4cc8-450f-8062-2f61033dd847 service nova] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:22 user nova-compute[75239]: DEBUG nova.compute.manager [req-f5f992b6-e5e0-415d-afac-727a42650af5 req-7c4e7896-4cc8-450f-8062-2f61033dd847 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] No waiting events found dispatching network-vif-plugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:58:22 user nova-compute[75239]: WARNING nova.compute.manager [req-f5f992b6-e5e0-415d-afac-727a42650af5 req-7c4e7896-4cc8-450f-8062-2f61033dd847 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received unexpected event network-vif-plugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 for instance with vm_state building and task_state spawning.
Nov 13 20:58:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:58:23 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Instance spawned successfully.
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:58:23 user nova-compute[75239]: INFO nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 13 20:58:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:58:24 user nova-compute[75239]: INFO nova.compute.manager [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Took 15.41 seconds to build instance.
Nov 13 20:58:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-0ee373e5-1e0c-4d46-8ba5-f898ac70d38a req-a4b66213-7156-46e2-bad0-d23ef422a77b service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received event network-vif-plugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:58:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0ee373e5-1e0c-4d46-8ba5-f898ac70d38a req-a4b66213-7156-46e2-bad0-d23ef422a77b service nova] Acquiring lock "87359099-25a3-4c68-8242-e611db1bcc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0ee373e5-1e0c-4d46-8ba5-f898ac70d38a req-a4b66213-7156-46e2-bad0-d23ef422a77b service nova] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0ee373e5-1e0c-4d46-8ba5-f898ac70d38a req-a4b66213-7156-46e2-bad0-d23ef422a77b service nova] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:24 user nova-compute[75239]: DEBUG nova.compute.manager [req-0ee373e5-1e0c-4d46-8ba5-f898ac70d38a req-a4b66213-7156-46e2-bad0-d23ef422a77b service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] No waiting events found dispatching network-vif-plugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:58:24 user nova-compute[75239]: WARNING nova.compute.manager [req-0ee373e5-1e0c-4d46-8ba5-f898ac70d38a req-a4b66213-7156-46e2-bad0-d23ef422a77b service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received unexpected event network-vif-plugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 for instance with vm_state active and task_state None.
Nov 13 20:58:24 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-587110bf-5205-4bc0-8399-95eda2ca6a19 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "87359099-25a3-4c68-8242-e611db1bcc77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.510s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:28 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692 is timed out.
Nov 13 20:58:28 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully detached device vdb from instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692 from the live domain config.
Nov 13 20:58:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oyIkeMQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:28 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad56ae4-d1a2-48fb-9cbf-6784d2132f82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:58:28 user nova-compute[75239]: No targets found.
Nov 13 20:58:28 user nova-compute[75239]: iSNS:
Nov 13 20:58:28 user nova-compute[75239]: No targets found.
Nov 13 20:58:28 user nova-compute[75239]: STATIC:
Nov 13 20:58:28 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a
Nov 13 20:58:28 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:58:28 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:58:28 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875
Nov 13 20:58:28 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:58:28 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:58:28 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee
Nov 13 20:58:28 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:58:28 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:58:28 user nova-compute[75239]: FIRMWARE:
Nov 13 20:58:28 user nova-compute[75239]: No targets found.
Nov 13 20:58:28 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:58:28 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:58:28 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b42b2a5-bc6a-465c-bfa1-fc7788aad931]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcebfdc-eb36-4723-b946-c7cdfdb11264]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:28 user nova-compute[75239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:28 user nova-compute[75239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:28 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a (non-flash)
Nov 13 20:58:28 user nova-compute[75239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:28 user nova-compute[75239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:28 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d845d1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad8f0d6-055d-4ac7-bb0d-d09bf6203e38]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[887014d2-595e-41d5-9bc9-d08058f3b8a3]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c3d6fc-509c-4475-b9c0-259ba4c4a111]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[16737f69-1c2d-42a9-b88d-4f759ec4ad45]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2308f652-9083-41ff-8103-8454f687c14b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d774145-6da0-4785-8a5a-6ff51a0ba720]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a, portal: 172.16.0.220,3260]
Nov 13 20:58:28 user nova-compute[75239]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a, portal: 172.16.0.220,3260] successful.
Nov 13 20:58:28 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3da5861-b0e3-43c0-9014-2ae2d4e2bf7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c0cd31-4680-4b4d-9354-912287220451]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] <== disconnect_volume: return (282ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:28 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:58:29 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'flavor' on Instance uuid 8cd0c72d-be0b-4ada-8149-b43f3bd52692 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2f760e45-2484-41e5-a9e2-a5adff242109 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:31 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c is timed out.
Nov 13 20:58:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully detached device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the live domain config.
Nov 13 20:58:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OzqBdVyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:31 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4b700c-eac9-472d-99d7-79c750d00f9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:58:31 user nova-compute[75239]: No targets found.
Nov 13 20:58:31 user nova-compute[75239]: iSNS:
Nov 13 20:58:31 user nova-compute[75239]: No targets found.
Nov 13 20:58:31 user nova-compute[75239]: STATIC:
Nov 13 20:58:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875
Nov 13 20:58:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:58:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:58:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee
Nov 13 20:58:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:58:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:58:31 user nova-compute[75239]: FIRMWARE:
Nov 13 20:58:31 user nova-compute[75239]: No targets found.
Nov 13 20:58:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:58:31 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:58:31 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ab3901-2494-4185-a6c4-821d02fa466d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ddf100-2dcb-49b0-913c-4afa1cba1322]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:31 user nova-compute[75239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 (non-flash)
Nov 13 20:58:31 user nova-compute[75239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d603e30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98f32be-a07b-48d8-ac02-5ac049754b2e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70acbb6-68ae-4ac2-8724-749d3c358a80]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[416580be-a370-4c00-8ac2-49482f696de2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb37792e-44d1-4242-815d-f50a41694936]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[996d2e2e-5cc1-435a-8ee9-3bdb3124f5e8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a01d4-edde-47e8-8c0e-fc89385b16a3]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875, portal: 172.16.0.220,3260]
Nov 13 20:58:31 user nova-compute[75239]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875, portal: 172.16.0.220,3260] successful.
Nov 13 20:58:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3f7563-0b00-46c2-bf29-76670694b875 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c035c3ec-beea-4107-a6db-224fe564f996]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== disconnect_volume: return (287ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:58:32 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d3a59a8a-2e52-42fc-aa1d-6fe194c8da31 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.629s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:58:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8375MB free_disk=24.902851104736328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c0591fd1-adfd-4626-806a-a71f46c80400 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance f847ff17-6194-42bb-862e-da3b64c15dea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 87359099-25a3-4c68-8242-e611db1bcc77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:58:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-b9e5abe3-4228-4322-8ced-4b8e33c0d3aa req-7ddb8de6-82ee-4cdc-87a9-dfebd71d9e17 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received event network-changed-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-b9e5abe3-4228-4322-8ced-4b8e33c0d3aa req-7ddb8de6-82ee-4cdc-87a9-dfebd71d9e17 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Refreshing instance network info cache due to event network-changed-370477ee-9538-4233-9fc1-2dea6b5813ac. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b9e5abe3-4228-4322-8ced-4b8e33c0d3aa req-7ddb8de6-82ee-4cdc-87a9-dfebd71d9e17 service nova] Acquiring lock "refresh_cache-f847ff17-6194-42bb-862e-da3b64c15dea" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b9e5abe3-4228-4322-8ced-4b8e33c0d3aa req-7ddb8de6-82ee-4cdc-87a9-dfebd71d9e17 service nova] Acquired lock "refresh_cache-f847ff17-6194-42bb-862e-da3b64c15dea" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-b9e5abe3-4228-4322-8ced-4b8e33c0d3aa req-7ddb8de6-82ee-4cdc-87a9-dfebd71d9e17 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Refreshing network info cache for port 370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'flavor' on Instance uuid f847ff17-6194-42bb-862e-da3b64c15dea {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:47 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Ignoring supplied device name: /dev/vdb
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:47 user nova-compute[75239]: INFO nova.compute.manager [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Attaching volume 0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 to /dev/vdb
Nov 13 20:58:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-b9e5abe3-4228-4322-8ced-4b8e33c0d3aa req-7ddb8de6-82ee-4cdc-87a9-dfebd71d9e17 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Updated VIF entry in instance network info cache for port 370477ee-9538-4233-9fc1-2dea6b5813ac. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-b9e5abe3-4228-4322-8ced-4b8e33c0d3aa req-7ddb8de6-82ee-4cdc-87a9-dfebd71d9e17 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Updating instance_info_cache with network_info: [{"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b9e5abe3-4228-4322-8ced-4b8e33c0d3aa req-7ddb8de6-82ee-4cdc-87a9-dfebd71d9e17 service nova] Releasing lock "refresh_cache-f847ff17-6194-42bb-862e-da3b64c15dea" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG os_brick.utils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f59cb7e-46cc-4e42-9879-60543931b698]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a415ca-5960-4ae9-b232-45f76845d49c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf75c0c-fe3e-49bd-a920-4084a6ddefd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[513c8780-8902-44db-bd7d-756589669f60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:58:47 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:58:47 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68e1cb8-f5d1-41e1-9a13-4bea28782c6f]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG os_brick.utils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:47 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Updating existing volume attachment record: 09004996-43ab-498d-8b1a-b00778d78afb {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:58:48 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:49 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:49 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObFLwBpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:58:51 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:51 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:58:51 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a41cda-e305-4596-9d7b-1a037fa38ea4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:58:51 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[406666f0-b77b-4fc1-a6fa-ca612fc51873]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675] added
Nov 13 20:58:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[819acfd4-f3de-492d-b62d-2fe36a9db96e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3301c1f9-1776-4e82-a9b7-120b4368c78f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObFLwBpM {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ObFLwBpM" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c88a117-4925-4c98-9dc4-17238dc44dfa]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ObFLwBpM'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a302652a-beee-45ea-9cf8-132e0fa6a7d6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a0d27-f4f4-4cf6-b189-577e0103dd0f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f2b7bc-05ea-4c0b-a390-6de077521d1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675, portal: 172.16.0.220,3260]
Nov 13 20:58:51 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675, portal: 172.16.0.220,3260] successful.
Nov 13 20:58:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[47288a79-30c4-4c8a-a7de-32c75ca5b996]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78132fb8-db60-4dee-a669-a9fe314dac67]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:51 user nova-compute[75239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)
Nov 13 20:58:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:58:51 user nova-compute[75239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)
Nov 13 20:58:51 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee3d5da-20c1-49ba-8f52-40c05359dca5]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:58:51 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:58:52 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:58:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObFLwBpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:58:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:58:52 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23935323939366130', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:58:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935323939366130', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:58:52 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'flavor' on Instance uuid f847ff17-6194-42bb-862e-da3b64c15dea {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:58:52 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:52 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:58:52 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:58:52 user nova-compute[75239]:   <serial>0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675</serial>
Nov 13 20:58:52 user nova-compute[75239]: </disk>
Nov 13 20:58:52 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:58:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:58:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:58:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] No VIF found with MAC fa:16:3e:2c:75:e5, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:58:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7c6f9dfd-473a-4cd8-84ae-78835ea9d5f2 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.986s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:54 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:58:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:58:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:58:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:58:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Updating instance_info_cache with network_info: [{"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:58:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-8cd0c72d-be0b-4ada-8149-b43f3bd52692" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:58:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:58:55 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 20:58:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:58 user nova-compute[75239]: INFO nova.compute.manager [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Terminating instance
Nov 13 20:58:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Instance destroyed successfully.
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'resources' on Instance uuid 8cd0c72d-be0b-4ada-8149-b43f3bd52692 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1448381069',display_name='tempest-AttachVolumeNegativeTest-server-1448381069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1448381069',id=44,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/WBUZooIt4eiSox2oczkA4peG7iwdzZGyE4EhFWmOpM68jPNDKPyVKe17Pph5TP28KOmJOE0gdA1dllLv6vBRN+ODFKVihXGSSYEzvapTEuj8JPBgiYWiVWi5IhJoOdg==',key_name='tempest-keypair-748617141',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-cpp1oczl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:56:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=8cd0c72d-be0b-4ada-8149-b43f3bd52692,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "address": "fa:16:3e:f6:0c:36", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9b5592d-d5", "ovs_interfaceid": "a9b5592d-d5d8-4e44-98f5-40ee4537554d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=a9b5592d-d5d8-4e44-98f5-40ee4537554d,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b5592d-d5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG os_vif [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=a9b5592d-d5d8-4e44-98f5-40ee4537554d,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b5592d-d5') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9b5592d-d5, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9acf3360-807b-42cc-b2b5-5eaf40daf4c6) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:58:59 user nova-compute[75239]: INFO os_vif [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:0c:36,bridge_name='br-int',has_traffic_filtering=True,id=a9b5592d-d5d8-4e44-98f5-40ee4537554d,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9b5592d-d5')
Nov 13 20:58:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Deleting instance files /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692_del
Nov 13 20:58:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Deletion of /opt/stack/data/nova/instances/8cd0c72d-be0b-4ada-8149-b43f3bd52692_del complete
Nov 13 20:58:59 user nova-compute[75239]: INFO nova.compute.manager [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 20:58:59 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-915d0cea-ce2f-4c83-830e-b2e3db33175c req-0e4c4051-1eec-4b6f-a1c8-0ad3b9706f43 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received event network-vif-unplugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-915d0cea-ce2f-4c83-830e-b2e3db33175c req-0e4c4051-1eec-4b6f-a1c8-0ad3b9706f43 service nova] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-915d0cea-ce2f-4c83-830e-b2e3db33175c req-0e4c4051-1eec-4b6f-a1c8-0ad3b9706f43 service nova] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-915d0cea-ce2f-4c83-830e-b2e3db33175c req-0e4c4051-1eec-4b6f-a1c8-0ad3b9706f43 service nova] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-915d0cea-ce2f-4c83-830e-b2e3db33175c req-0e4c4051-1eec-4b6f-a1c8-0ad3b9706f43 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] No waiting events found dispatching network-vif-unplugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-915d0cea-ce2f-4c83-830e-b2e3db33175c req-0e4c4051-1eec-4b6f-a1c8-0ad3b9706f43 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received event network-vif-unplugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:58:59 user nova-compute[75239]: INFO nova.compute.manager [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Detaching volume 0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675
Nov 13 20:58:59 user nova-compute[75239]: INFO nova.virt.block_device [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Attempting to driver detach volume 0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 from mountpoint /dev/vdb
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Attempting to detach device vdb from instance f847ff17-6194-42bb-862e-da3b64c15dea from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:58:59 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:59 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:58:59 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:58:59 user nova-compute[75239]:   <serial>0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675</serial>
Nov 13 20:58:59 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:58:59 user nova-compute[75239]: </disk>
Nov 13 20:58:59 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:58:59 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Successfully detached device vdb from instance f847ff17-6194-42bb-862e-da3b64c15dea from the persistent domain config.
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f847ff17-6194-42bb-862e-da3b64c15dea from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:58:59 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:58:59 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 20:58:59 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:58:59 user nova-compute[75239]:   <serial>0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675</serial>
Nov 13 20:58:59 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:58:59 user nova-compute[75239]: </disk>
Nov 13 20:58:59 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:58:59 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Took 0.81 seconds to deallocate network for instance.
Nov 13 20:58:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-c4a4c350-8a9a-4b35-982b-249aa935834a req-411e980c-fa41-4782-abcc-5b9bba42a716 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received event network-vif-deleted-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:59:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:00 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:59:00 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:59:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:00 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Deleted allocations for instance 8cd0c72d-be0b-4ada-8149-b43f3bd52692
Nov 13 20:59:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f847ff17-6194-42bb-862e-da3b64c15dea {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:59:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b0421c7-a34f-4a94-abf1-c4afd50aec21 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.074s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-a96d04bf-e661-4d60-9ded-fd868ada7512 req-c407757c-e692-4e02-b3eb-8c54d48f36f1 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received event network-vif-plugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:59:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a96d04bf-e661-4d60-9ded-fd868ada7512 req-c407757c-e692-4e02-b3eb-8c54d48f36f1 service nova] Acquiring lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a96d04bf-e661-4d60-9ded-fd868ada7512 req-c407757c-e692-4e02-b3eb-8c54d48f36f1 service nova] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a96d04bf-e661-4d60-9ded-fd868ada7512 req-c407757c-e692-4e02-b3eb-8c54d48f36f1 service nova] Lock "8cd0c72d-be0b-4ada-8149-b43f3bd52692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-a96d04bf-e661-4d60-9ded-fd868ada7512 req-c407757c-e692-4e02-b3eb-8c54d48f36f1 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] No waiting events found dispatching network-vif-plugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:59:01 user nova-compute[75239]: WARNING nova.compute.manager [req-a96d04bf-e661-4d60-9ded-fd868ada7512 req-c407757c-e692-4e02-b3eb-8c54d48f36f1 service nova] [instance: 8cd0c72d-be0b-4ada-8149-b43f3bd52692] Received unexpected event network-vif-plugged-a9b5592d-d5d8-4e44-98f5-40ee4537554d for instance with vm_state deleted and task_state None.
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:02 user nova-compute[75239]: INFO nova.compute.manager [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attaching volume 883f4b0e-409f-48dc-9ea5-09404ef3f4a7 to /dev/vdb
Nov 13 20:59:02 user nova-compute[75239]: DEBUG os_brick.utils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5c81ee-3e5b-4479-8053-63bc99494415]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec154004-8915-4631-a338-e5f78a31eb05]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a873cac3-f2c9-4852-8833-90eca4020a51]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[327cbf61-7648-4272-94dc-b53d4add69a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 20:59:02 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 20:59:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadc8f9a-98bf-4fc0-903b-a0490a4ebaba]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG os_brick.utils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:59:02 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating existing volume attachment record: c10add1b-b49e-49d7-bbfc-25e5cf38dfd2 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 20:59:03 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zFTRyfQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:59:06 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:59:06 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:59:06 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[922cd922-0a95-43ee-9553-e81b78f5b052]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 20:59:06 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2b3fb1-20d2-430c-a170-f4691e30f0ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7] added
Nov 13 20:59:06 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2340e0-10f4-41a5-b8ef-a8623da1ec86]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f062d459-d33a-4dd6-8761-3f9e60da1018]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zFTRyfQY {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zFTRyfQY" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce71f38-9665-4218-a60f-bb5d98164d39]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zFTRyfQY'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b42aff-b716-4b2b-a301-9abb74c93834]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc382df-4c05-4817-ad70-98cf2937eb57]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:07 user nova-compute[75239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)
Nov 13 20:59:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:07 user nova-compute[75239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)
Nov 13 20:59:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc2c9cc-8cab-483a-8065-307260b5808e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7, portal: 172.16.0.220,3260]
Nov 13 20:59:07 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7, portal: 172.16.0.220,3260] successful.
Nov 13 20:59:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc72aba-093a-42ac-9657-ad107521af91]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f8076-d2ab-40fa-adc2-b00c8e2b354e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:07 user nova-compute[75239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)
Nov 13 20:59:07 user nova-compute[75239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)
Nov 13 20:59:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:07 user nova-compute[75239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)
Nov 13 20:59:07 user nova-compute[75239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)
Nov 13 20:59:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[031a67d3-71e0-4d75-bffd-1fc4efbfc646]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:07 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zFTRyfQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23161356337336165', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23161356337336165', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 20:59:08 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:59:08 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:59:08 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:59:08 user nova-compute[75239]:   <serial>883f4b0e-409f-48dc-9ea5-09404ef3f4a7</serial>
Nov 13 20:59:08 user nova-compute[75239]: </disk>
Nov 13 20:59:08 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No VIF found with MAC fa:16:3e:01:c9:f0, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:59:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6577aa1e-6992-4e72-a1d3-c1e58c12a7da tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.932s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:10 user nova-compute[75239]: INFO nova.compute.manager [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Detaching volume 883f4b0e-409f-48dc-9ea5-09404ef3f4a7
Nov 13 20:59:10 user nova-compute[75239]: INFO nova.virt.block_device [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attempting to driver detach volume 883f4b0e-409f-48dc-9ea5-09404ef3f4a7 from mountpoint /dev/vdb
Nov 13 20:59:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Attempting to detach device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 20:59:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:59:10 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:59:10 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:59:10 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:59:10 user nova-compute[75239]:   <serial>883f4b0e-409f-48dc-9ea5-09404ef3f4a7</serial>
Nov 13 20:59:10 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:59:10 user nova-compute[75239]: </disk>
Nov 13 20:59:10 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:59:10 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully detached device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the persistent domain config.
Nov 13 20:59:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 20:59:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 20:59:10 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 20:59:10 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 20:59:10 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 20:59:10 user nova-compute[75239]:   <serial>883f4b0e-409f-48dc-9ea5-09404ef3f4a7</serial>
Nov 13 20:59:10 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 20:59:10 user nova-compute[75239]: </disk>
Nov 13 20:59:10 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 20:59:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid c0591fd1-adfd-4626-806a-a71f46c80400 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid f847ff17-6194-42bb-862e-da3b64c15dea {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 87359099-25a3-4c68-8242-e611db1bcc77 {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "c0591fd1-adfd-4626-806a-a71f46c80400" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "c0591fd1-adfd-4626-806a-a71f46c80400" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "87359099-25a3-4c68-8242-e611db1bcc77" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "87359099-25a3-4c68-8242-e611db1bcc77" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "c0591fd1-adfd-4626-806a-a71f46c80400" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "87359099-25a3-4c68-8242-e611db1bcc77" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:20 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f847ff17-6194-42bb-862e-da3b64c15dea is timed out.
Nov 13 20:59:20 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Successfully detached device vdb from instance f847ff17-6194-42bb-862e-da3b64c15dea from the live domain config.
Nov 13 20:59:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObFLwBpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:59:20 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[713656e2-ce44-4e31-bdca-9b24519178ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:59:20 user nova-compute[75239]: No targets found.
Nov 13 20:59:20 user nova-compute[75239]: iSNS:
Nov 13 20:59:20 user nova-compute[75239]: No targets found.
Nov 13 20:59:20 user nova-compute[75239]: STATIC:
Nov 13 20:59:20 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7
Nov 13 20:59:20 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:59:20 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:59:20 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675
Nov 13 20:59:20 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:59:20 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:59:20 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee
Nov 13 20:59:20 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:59:20 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:59:20 user nova-compute[75239]: FIRMWARE:
Nov 13 20:59:20 user nova-compute[75239]: No targets found.
Nov 13 20:59:20 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:59:20 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:59:20 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe6e3a1-36d5-45f5-ac33-de9d2806b390]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6376004-b541-4208-ab1b-197ec7f86d54]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:20 user nova-compute[75239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)
Nov 13 20:59:20 user nova-compute[75239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)
Nov 13 20:59:20 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:20 user nova-compute[75239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 (non-flash)
Nov 13 20:59:20 user nova-compute[75239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)
Nov 13 20:59:20 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d845d1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[832822e6-12ad-469b-9059-6ecddba3ddae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb6d26c-289c-447a-a1e1-2a69fb4846cb]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00fd9aa-afc2-47ea-8844-5682d2a0c279]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c49dea-5b89-4183-a96a-4051e4292366]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab82c558-0424-47f4-977d-825c9e11c4ae]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56422a1-0d18-40c1-9044-dd9732ec9c7b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675, portal: 172.16.0.220,3260]
Nov 13 20:59:20 user nova-compute[75239]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675, portal: 172.16.0.220,3260] successful.
Nov 13 20:59:20 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e04eb51-8bf6-44d3-9a6c-b7a62734bd26]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] <== disconnect_volume: return (306ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:59:20 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG nova.objects.instance [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'flavor' on Instance uuid f847ff17-6194-42bb-862e-da3b64c15dea {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-1024d7b0-baf8-4ceb-ab53-7809a6387542 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.605s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.487s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:21 user nova-compute[75239]: INFO nova.compute.manager [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Terminating instance
Nov 13 20:59:21 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-6a509cde-5afc-4e98-8f74-5bb06df04126 req-00fc4d32-d175-4f20-b079-a93756e966cb service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received event network-vif-unplugged-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6a509cde-5afc-4e98-8f74-5bb06df04126 req-00fc4d32-d175-4f20-b079-a93756e966cb service nova] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6a509cde-5afc-4e98-8f74-5bb06df04126 req-00fc4d32-d175-4f20-b079-a93756e966cb service nova] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6a509cde-5afc-4e98-8f74-5bb06df04126 req-00fc4d32-d175-4f20-b079-a93756e966cb service nova] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-6a509cde-5afc-4e98-8f74-5bb06df04126 req-00fc4d32-d175-4f20-b079-a93756e966cb service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] No waiting events found dispatching network-vif-unplugged-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:59:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-6a509cde-5afc-4e98-8f74-5bb06df04126 req-00fc4d32-d175-4f20-b079-a93756e966cb service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received event network-vif-unplugged-370477ee-9538-4233-9fc1-2dea6b5813ac for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 20:59:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Instance destroyed successfully.
Nov 13 20:59:22 user nova-compute[75239]: DEBUG nova.objects.instance [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lazy-loading 'resources' on Instance uuid f847ff17-6194-42bb-862e-da3b64c15dea {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1890742248',display_name='tempest-VolumesSnapshotTestJSON-instance-1890742248',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1890742248',id=45,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv7DEkWQNUg+u3HwCY5YfpwAB/ohf3vsw7JlmovSW1moQR3/zDY/9gkVTRaDE90Myg0H24PljucuZ4TNu6H0MIbFj/sh4htpJfaFulV710Xht9iVDUeLCOak0pbliIWBQ==',key_name='tempest-keypair-807672837',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:57:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='909c29838280436f85a2242f1c344eef',ramdisk_id='',reservation_id='r-iau1xxrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-77894400',owner_user_name='tempest-VolumesSnapshotTestJSON-77894400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:57:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bc1e54d23824501a21398dd0410bba1',uuid=f847ff17-6194-42bb-862e-da3b64c15dea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converting VIF {"id": "370477ee-9538-4233-9fc1-2dea6b5813ac", "address": "fa:16:3e:2c:75:e5", "network": {"id": "e1f082d4-a229-406d-bf85-a87e5b323c5d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-388638410-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "909c29838280436f85a2242f1c344eef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap370477ee-95", "ovs_interfaceid": "370477ee-9538-4233-9fc1-2dea6b5813ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:75:e5,bridge_name='br-int',has_traffic_filtering=True,id=370477ee-9538-4233-9fc1-2dea6b5813ac,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370477ee-95') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_vif [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:75:e5,bridge_name='br-int',has_traffic_filtering=True,id=370477ee-9538-4233-9fc1-2dea6b5813ac,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370477ee-95') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap370477ee-95, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02d39c4d-a2bd-4516-b021-2dc8d5858d1d) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:22 user nova-compute[75239]: INFO os_vif [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:75:e5,bridge_name='br-int',has_traffic_filtering=True,id=370477ee-9538-4233-9fc1-2dea6b5813ac,network=Network(e1f082d4-a229-406d-bf85-a87e5b323c5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap370477ee-95')
Nov 13 20:59:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ObFLwBpM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:59:22 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5071804b-eb6a-4e30-b6f2-756cbe333ad4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:59:22 user nova-compute[75239]: No targets found.
Nov 13 20:59:22 user nova-compute[75239]: iSNS:
Nov 13 20:59:22 user nova-compute[75239]: No targets found.
Nov 13 20:59:22 user nova-compute[75239]: STATIC:
Nov 13 20:59:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7
Nov 13 20:59:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:59:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:59:22 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee
Nov 13 20:59:22 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:59:22 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:59:22 user nova-compute[75239]: FIRMWARE:
Nov 13 20:59:22 user nova-compute[75239]: No targets found.
Nov 13 20:59:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:59:22 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:59:22 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c2b5fca-fb0a-4c65-9a0b-5c0867a5b675', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edc9dd6-3885-4ddd-ad0e-1d22cf34126e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b1000d-c571-4e30-9da4-91dfd7a96d46]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:22 user nova-compute[75239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)
Nov 13 20:59:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:22 user nova-compute[75239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)
Nov 13 20:59:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60211870>, {}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Disconnecting from: [] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] <== disconnect_volume: return (73ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:59:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Deleting instance files /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea_del
Nov 13 20:59:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Deletion of /opt/stack/data/nova/instances/f847ff17-6194-42bb-862e-da3b64c15dea_del complete
Nov 13 20:59:22 user nova-compute[75239]: INFO nova.compute.manager [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 13 20:59:22 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 20:59:22 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:59:23 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Took 1.11 seconds to deallocate network for instance.
Nov 13 20:59:23 user nova-compute[75239]: WARNING nova.volume.cinder [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Attachment 09004996-43ab-498d-8b1a-b00778d78afb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 09004996-43ab-498d-8b1a-b00778d78afb. (HTTP 404) (Request-ID: req-00c4ebfc-a708-4c40-bd14-1ab8dddadffc)
Nov 13 20:59:23 user nova-compute[75239]: INFO nova.compute.manager [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Took 0.02 seconds to detach 1 volumes for instance.
Nov 13 20:59:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b5ab862-300a-45ec-9832-c1baea75dd27 req-9d7f3317-920b-4d6f-9a84-34af9eb67312 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received event network-vif-plugged-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b5ab862-300a-45ec-9832-c1baea75dd27 req-9d7f3317-920b-4d6f-9a84-34af9eb67312 service nova] Acquiring lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b5ab862-300a-45ec-9832-c1baea75dd27 req-9d7f3317-920b-4d6f-9a84-34af9eb67312 service nova] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6b5ab862-300a-45ec-9832-c1baea75dd27 req-9d7f3317-920b-4d6f-9a84-34af9eb67312 service nova] Lock "f847ff17-6194-42bb-862e-da3b64c15dea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b5ab862-300a-45ec-9832-c1baea75dd27 req-9d7f3317-920b-4d6f-9a84-34af9eb67312 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] No waiting events found dispatching network-vif-plugged-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:59:23 user nova-compute[75239]: WARNING nova.compute.manager [req-6b5ab862-300a-45ec-9832-c1baea75dd27 req-9d7f3317-920b-4d6f-9a84-34af9eb67312 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received unexpected event network-vif-plugged-370477ee-9538-4233-9fc1-2dea6b5813ac for instance with vm_state deleted and task_state None.
Nov 13 20:59:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-6b5ab862-300a-45ec-9832-c1baea75dd27 req-9d7f3317-920b-4d6f-9a84-34af9eb67312 service nova] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] Received event network-vif-deleted-370477ee-9538-4233-9fc1-2dea6b5813ac {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:23 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Deleted allocations for instance f847ff17-6194-42bb-862e-da3b64c15dea
Nov 13 20:59:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5b783750-6c6b-40d3-b22d-8683dcc55c98 tempest-VolumesSnapshotTestJSON-77894400 tempest-VolumesSnapshotTestJSON-77894400-project-member] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.427s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.188s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:23 user nova-compute[75239]: INFO nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: f847ff17-6194-42bb-862e-da3b64c15dea] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 13 20:59:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "f847ff17-6194-42bb-862e-da3b64c15dea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:31 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c is timed out.
Nov 13 20:59:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully detached device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the live domain config.
Nov 13 20:59:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zFTRyfQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 20:59:31 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34770487-c9b2-41dc-9c48-d42de02de673]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 20:59:31 user nova-compute[75239]: No targets found.
Nov 13 20:59:31 user nova-compute[75239]: iSNS:
Nov 13 20:59:31 user nova-compute[75239]: No targets found.
Nov 13 20:59:31 user nova-compute[75239]: STATIC:
Nov 13 20:59:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7
Nov 13 20:59:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:59:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:59:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee
Nov 13 20:59:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 20:59:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 20:59:31 user nova-compute[75239]: FIRMWARE:
Nov 13 20:59:31 user nova-compute[75239]: No targets found.
Nov 13 20:59:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 20:59:31 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 20:59:31 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3634392b-6698-4a29-96fb-109c9c7e7e43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f4b5ab-8ab2-4d6b-8098-561e3c364279]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:31 user nova-compute[75239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)
Nov 13 20:59:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 20:59:31 user nova-compute[75239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 (non-flash)
Nov 13 20:59:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d6059b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62a26e0-14b8-4e33-9361-5f3aee5049ae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e64191e-2a37-46b3-b2e3-80fe97efa913]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff94471a-4584-4bb7-b56d-8a6d9d096c3e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c964302-154d-4a36-ab96-958124999af9]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6151a5b2-37e4-4b2f-8052-e6747ed2cd0d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd686808-7d55-4894-a814-100de0cf8489]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7, portal: 172.16.0.220,3260]
Nov 13 20:59:31 user nova-compute[75239]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7, portal: 172.16.0.220,3260] successful.
Nov 13 20:59:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:883f4b0e-409f-48dc-9ea5-09404ef3f4a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9edc39-2cdb-4499-8a3e-418010005564]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== disconnect_volume: return (302ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 20:59:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 20:59:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:59:32 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:59:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6ba3bf38-bf03-48b7-9cde-c10be142f381 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.642s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.859s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:32 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:42 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:43 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:59:43 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:59:43 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=24.948894500732422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c0591fd1-adfd-4626-806a-a71f46c80400 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 87359099-25a3-4c68-8242-e611db1bcc77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 20:59:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 20:59:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:59:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:48 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:49 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 20:59:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:51 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 20:59:51 user nova-compute[75239]: INFO nova.compute.claims [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Claim successful on node user
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 20:59:52 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.policy [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa7ce2c9a26e403d9d802d354b43e8e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f422c15f5d0d4a62ad37feabca7faa03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 20:59:52 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Creating image(s)
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "/opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "/opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "/opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.228s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk 1073741824" returned: 0 in 0.056s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:52 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Successfully created port: f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Cannot resize image /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Ensure instance console log exists: /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Successfully updated port: f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "refresh_cache-6af4e2a4-aa89-4c03-952e-af45772ab9de" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquired lock "refresh_cache-6af4e2a4-aa89-4c03-952e-af45772ab9de" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.compute.manager [req-650571b4-7b37-4788-bf61-c8db652f22ae req-83bbfac2-1545-4b3f-b087-739ac63b051e service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received event network-changed-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.compute.manager [req-650571b4-7b37-4788-bf61-c8db652f22ae req-83bbfac2-1545-4b3f-b087-739ac63b051e service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Refreshing instance network info cache due to event network-changed-f8858bfb-493f-43aa-9dba-69fbd6816924. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-650571b4-7b37-4788-bf61-c8db652f22ae req-83bbfac2-1545-4b3f-b087-739ac63b051e service nova] Acquiring lock "refresh_cache-6af4e2a4-aa89-4c03-952e-af45772ab9de" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Updating instance_info_cache with network_info: [{"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Releasing lock "refresh_cache-6af4e2a4-aa89-4c03-952e-af45772ab9de" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Instance network_info: |[{"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-650571b4-7b37-4788-bf61-c8db652f22ae req-83bbfac2-1545-4b3f-b087-739ac63b051e service nova] Acquired lock "refresh_cache-6af4e2a4-aa89-4c03-952e-af45772ab9de" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.network.neutron [req-650571b4-7b37-4788-bf61-c8db652f22ae req-83bbfac2-1545-4b3f-b087-739ac63b051e service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Refreshing network info cache for port f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Start _get_guest_xml network_info=[{"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 20:59:53 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:59:53 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-418133690',display_name='tempest-AttachVolumeNegativeTest-server-418133690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-418133690',id=47,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJsRWLVB+ruDpelPqY4bDMAOq68pMZ7JnHs/bqx8e3lqgTLV+8YkGzkgBOLESYJjfAwGAfirRSYT7ncaTsQAcxKQUjPNnELsisTB2+4tx9i7+m9EPbXzDiVWFvz9GNYzQ==',key_name='tempest-keypair-1741528995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-n6eqob0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=6af4e2a4-aa89-4c03-952e-af45772ab9de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:83,bridge_name='br-int',has_traffic_filtering=True,id=f8858bfb-493f-43aa-9dba-69fbd6816924,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8858bfb-49') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'pci_devices' on Instance uuid 6af4e2a4-aa89-4c03-952e-af45772ab9de {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] End _get_guest_xml xml=<domain type="kvm">
Nov 13 20:59:53 user nova-compute[75239]:   <uuid>6af4e2a4-aa89-4c03-952e-af45772ab9de</uuid>
Nov 13 20:59:53 user nova-compute[75239]:   <name>instance-0000002f</name>
Nov 13 20:59:53 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 20:59:53 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 20:59:53 user nova-compute[75239]:   <metadata>
Nov 13 20:59:53 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 20:59:53 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 20:59:53 user nova-compute[75239]:       <nova:name>tempest-AttachVolumeNegativeTest-server-418133690</nova:name>
Nov 13 20:59:53 user nova-compute[75239]:       <nova:creationTime>2023-11-13 20:59:53</nova:creationTime>
Nov 13 20:59:53 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 20:59:53 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 20:59:53 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 20:59:53 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 20:59:53 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 20:59:53 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 20:59:53 user nova-compute[75239]:       </nova:flavor>
Nov 13 20:59:53 user nova-compute[75239]:       <nova:owner>
Nov 13 20:59:53 user nova-compute[75239]:         <nova:user uuid="fa7ce2c9a26e403d9d802d354b43e8e7">tempest-AttachVolumeNegativeTest-1236383897-project-member</nova:user>
Nov 13 20:59:53 user nova-compute[75239]:         <nova:project uuid="f422c15f5d0d4a62ad37feabca7faa03">tempest-AttachVolumeNegativeTest-1236383897</nova:project>
Nov 13 20:59:53 user nova-compute[75239]:       </nova:owner>
Nov 13 20:59:53 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 20:59:53 user nova-compute[75239]:       <nova:ports>
Nov 13 20:59:53 user nova-compute[75239]:         <nova:port uuid="f8858bfb-493f-43aa-9dba-69fbd6816924">
Nov 13 20:59:53 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 20:59:53 user nova-compute[75239]:         </nova:port>
Nov 13 20:59:53 user nova-compute[75239]:       </nova:ports>
Nov 13 20:59:53 user nova-compute[75239]:     </nova:instance>
Nov 13 20:59:53 user nova-compute[75239]:   </metadata>
Nov 13 20:59:53 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 20:59:53 user nova-compute[75239]:     <system>
Nov 13 20:59:53 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 20:59:53 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 20:59:53 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 20:59:53 user nova-compute[75239]:       <entry name="serial">6af4e2a4-aa89-4c03-952e-af45772ab9de</entry>
Nov 13 20:59:53 user nova-compute[75239]:       <entry name="uuid">6af4e2a4-aa89-4c03-952e-af45772ab9de</entry>
Nov 13 20:59:53 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 20:59:53 user nova-compute[75239]:     </system>
Nov 13 20:59:53 user nova-compute[75239]:   </sysinfo>
Nov 13 20:59:53 user nova-compute[75239]:   <os>
Nov 13 20:59:53 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 20:59:53 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 20:59:53 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 20:59:53 user nova-compute[75239]:   </os>
Nov 13 20:59:53 user nova-compute[75239]:   <features>
Nov 13 20:59:53 user nova-compute[75239]:     <acpi/>
Nov 13 20:59:53 user nova-compute[75239]:     <apic/>
Nov 13 20:59:53 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 20:59:53 user nova-compute[75239]:   </features>
Nov 13 20:59:53 user nova-compute[75239]:   <clock offset="utc">
Nov 13 20:59:53 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 20:59:53 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 20:59:53 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 20:59:53 user nova-compute[75239]:   </clock>
Nov 13 20:59:53 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 20:59:53 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 20:59:53 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 20:59:53 user nova-compute[75239]:   </cpu>
Nov 13 20:59:53 user nova-compute[75239]:   <devices>
Nov 13 20:59:53 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 20:59:53 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 20:59:53 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk"/>
Nov 13 20:59:53 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 20:59:53 user nova-compute[75239]:     </disk>
Nov 13 20:59:53 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 20:59:53 user nova-compute[75239]:       <mac address="fa:16:3e:f4:55:83"/>
Nov 13 20:59:53 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:59:53 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 20:59:53 user nova-compute[75239]:       <target dev="tapf8858bfb-49"/>
Nov 13 20:59:53 user nova-compute[75239]:     </interface>
Nov 13 20:59:53 user nova-compute[75239]:     <serial type="pty">
Nov 13 20:59:53 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/console.log" append="off"/>
Nov 13 20:59:53 user nova-compute[75239]:     </serial>
Nov 13 20:59:53 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 20:59:53 user nova-compute[75239]:     <video>
Nov 13 20:59:53 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 20:59:53 user nova-compute[75239]:     </video>
Nov 13 20:59:53 user nova-compute[75239]:     <rng model="virtio">
Nov 13 20:59:53 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 20:59:53 user nova-compute[75239]:     </rng>
Nov 13 20:59:53 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 20:59:53 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 20:59:53 user nova-compute[75239]:       <stats period="10"/>
Nov 13 20:59:53 user nova-compute[75239]:     </memballoon>
Nov 13 20:59:53 user nova-compute[75239]:   </devices>
Nov 13 20:59:53 user nova-compute[75239]: </domain>
Nov 13 20:59:53 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-418133690',display_name='tempest-AttachVolumeNegativeTest-server-418133690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-418133690',id=47,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJsRWLVB+ruDpelPqY4bDMAOq68pMZ7JnHs/bqx8e3lqgTLV+8YkGzkgBOLESYJjfAwGAfirRSYT7ncaTsQAcxKQUjPNnELsisTB2+4tx9i7+m9EPbXzDiVWFvz9GNYzQ==',key_name='tempest-keypair-1741528995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-n6eqob0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T20:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=6af4e2a4-aa89-4c03-952e-af45772ab9de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:83,bridge_name='br-int',has_traffic_filtering=True,id=f8858bfb-493f-43aa-9dba-69fbd6816924,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8858bfb-49') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG os_vif [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:83,bridge_name='br-int',has_traffic_filtering=True,id=f8858bfb-493f-43aa-9dba-69fbd6816924,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8858bfb-49') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dfb31454-db3b-5e48-b0b2-03991e43dd60', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8858bfb-49, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8858bfb-49, col_values=(('qos', UUID('e6a66d25-f098-4df9-9ff2-d62d407d0872')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8858bfb-49, col_values=(('external_ids', {'iface-id': 'f8858bfb-493f-43aa-9dba-69fbd6816924', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:55:83', 'vm-uuid': '6af4e2a4-aa89-4c03-952e-af45772ab9de'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:53 user nova-compute[75239]: INFO os_vif [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:55:83,bridge_name='br-int',has_traffic_filtering=True,id=f8858bfb-493f-43aa-9dba-69fbd6816924,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8858bfb-49')
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 20:59:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No VIF found with MAC fa:16:3e:f4:55:83, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-650571b4-7b37-4788-bf61-c8db652f22ae req-83bbfac2-1545-4b3f-b087-739ac63b051e service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Updated VIF entry in instance network info cache for port f8858bfb-493f-43aa-9dba-69fbd6816924. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG nova.network.neutron [req-650571b4-7b37-4788-bf61-c8db652f22ae req-83bbfac2-1545-4b3f-b087-739ac63b051e service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Updating instance_info_cache with network_info: [{"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-650571b4-7b37-4788-bf61-c8db652f22ae req-83bbfac2-1545-4b3f-b087-739ac63b051e service nova] Releasing lock "refresh_cache-6af4e2a4-aa89-4c03-952e-af45772ab9de" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Skipping network cache update for instance because it is Building. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid c0591fd1-adfd-4626-806a-a71f46c80400 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updating instance_info_cache with network_info: [{"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-c0591fd1-adfd-4626-806a-a71f46c80400" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 20:59:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-1c28ae9b-e18f-471a-bd0f-ad3f093d334f req-3e8cc956-d3f4-47bb-b908-35e4d57abce0 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received event network-vif-plugged-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1c28ae9b-e18f-471a-bd0f-ad3f093d334f req-3e8cc956-d3f4-47bb-b908-35e4d57abce0 service nova] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1c28ae9b-e18f-471a-bd0f-ad3f093d334f req-3e8cc956-d3f4-47bb-b908-35e4d57abce0 service nova] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1c28ae9b-e18f-471a-bd0f-ad3f093d334f req-3e8cc956-d3f4-47bb-b908-35e4d57abce0 service nova] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-1c28ae9b-e18f-471a-bd0f-ad3f093d334f req-3e8cc956-d3f4-47bb-b908-35e4d57abce0 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] No waiting events found dispatching network-vif-plugged-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:59:55 user nova-compute[75239]: WARNING nova.compute.manager [req-1c28ae9b-e18f-471a-bd0f-ad3f093d334f req-3e8cc956-d3f4-47bb-b908-35e4d57abce0 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received unexpected event network-vif-plugged-f8858bfb-493f-43aa-9dba-69fbd6816924 for instance with vm_state building and task_state spawning.
Nov 13 20:59:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 20:59:57 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Instance spawned successfully.
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 20:59:57 user nova-compute[75239]: INFO nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 20:59:57 user nova-compute[75239]: INFO nova.compute.manager [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Took 5.61 seconds to build instance.
Nov 13 20:59:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6f399868-6a86-470d-b635-a2beb2fa9606 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.783s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ce19d6a-71ae-44c0-9223-25b478b2425f req-9c2f3329-f5e2-46f0-a39f-886300f214a2 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received event network-vif-plugged-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ce19d6a-71ae-44c0-9223-25b478b2425f req-9c2f3329-f5e2-46f0-a39f-886300f214a2 service nova] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ce19d6a-71ae-44c0-9223-25b478b2425f req-9c2f3329-f5e2-46f0-a39f-886300f214a2 service nova] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-8ce19d6a-71ae-44c0-9223-25b478b2425f req-9c2f3329-f5e2-46f0-a39f-886300f214a2 service nova] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:57 user nova-compute[75239]: DEBUG nova.compute.manager [req-8ce19d6a-71ae-44c0-9223-25b478b2425f req-9c2f3329-f5e2-46f0-a39f-886300f214a2 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] No waiting events found dispatching network-vif-plugged-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 20:59:57 user nova-compute[75239]: WARNING nova.compute.manager [req-8ce19d6a-71ae-44c0-9223-25b478b2425f req-9c2f3329-f5e2-46f0-a39f-886300f214a2 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received unexpected event network-vif-plugged-f8858bfb-493f-43aa-9dba-69fbd6816924 for instance with vm_state active and task_state None.
Nov 13 20:59:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "87359099-25a3-4c68-8242-e611db1bcc77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "87359099-25a3-4c68-8242-e611db1bcc77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "87359099-25a3-4c68-8242-e611db1bcc77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 20:59:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 20:59:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 20:59:59 user nova-compute[75239]: INFO nova.compute.manager [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Terminating instance
Nov 13 20:59:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 20:59:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 20:59:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG nova.compute.manager [req-941342ab-069d-4e0b-8dc8-dcc402fb3985 req-1984f724-9215-44c6-abc6-87c364248b06 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received event network-vif-unplugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-941342ab-069d-4e0b-8dc8-dcc402fb3985 req-1984f724-9215-44c6-abc6-87c364248b06 service nova] Acquiring lock "87359099-25a3-4c68-8242-e611db1bcc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-941342ab-069d-4e0b-8dc8-dcc402fb3985 req-1984f724-9215-44c6-abc6-87c364248b06 service nova] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-941342ab-069d-4e0b-8dc8-dcc402fb3985 req-1984f724-9215-44c6-abc6-87c364248b06 service nova] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG nova.compute.manager [req-941342ab-069d-4e0b-8dc8-dcc402fb3985 req-1984f724-9215-44c6-abc6-87c364248b06 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] No waiting events found dispatching network-vif-unplugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG nova.compute.manager [req-941342ab-069d-4e0b-8dc8-dcc402fb3985 req-1984f724-9215-44c6-abc6-87c364248b06 service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received event network-vif-unplugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:00:00 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Instance destroyed successfully.
Nov 13 21:00:00 user nova-compute[75239]: DEBUG nova.objects.instance [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'resources' on Instance uuid 87359099-25a3-4c68-8242-e611db1bcc77 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-620633066',display_name='tempest-TestVolumeBootPattern-server-620633066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-620633066',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:58:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-dsaukclb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:58:24Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=87359099-25a3-4c68-8242-e611db1bcc77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "address": "fa:16:3e:2a:af:65", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f883aa8-9e", "ovs_interfaceid": "4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:af:65,bridge_name='br-int',has_traffic_filtering=True,id=4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f883aa8-9e') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_vif [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:af:65,bridge_name='br-int',has_traffic_filtering=True,id=4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f883aa8-9e') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f883aa8-9e, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a82e675a-366c-4106-86c3-49e0bc38123d) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:00:00 user nova-compute[75239]: INFO os_vif [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:af:65,bridge_name='br-int',has_traffic_filtering=True,id=4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f883aa8-9e')
Nov 13 21:00:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JEKyMieX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:00:00 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aacdfc6-2b29-46ce-813f-86a61e532974]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:00:00 user nova-compute[75239]: No targets found.
Nov 13 21:00:00 user nova-compute[75239]: iSNS:
Nov 13 21:00:00 user nova-compute[75239]: No targets found.
Nov 13 21:00:00 user nova-compute[75239]: STATIC:
Nov 13 21:00:00 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee
Nov 13 21:00:00 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:00:00 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:00:00 user nova-compute[75239]: FIRMWARE:
Nov 13 21:00:00 user nova-compute[75239]: No targets found.
Nov 13 21:00:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:00:00 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:00:00 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6477f3-b5d3-4252-83ab-e14665e8ea74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.052s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f874a8-681c-4a4e-b59c-aeb37871f711]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 21:00:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee (non-flash)
Nov 13 21:00:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60591900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee'): ({'sdd'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Removing single pathed devices sdd {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc167ac-f53a-41c3-8111-11e18afa0a72]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1948cfc-8261-4697-820f-54274cf2b29c]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flushing IO for device /dev/sdd {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c6c077-a198-4f04-8df5-3a78d3e32513]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0716436-508c-49d6-b561-e5c7a0a02c43]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] SCSI volumes sdd have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23664336432643239', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fdea2076', '/dev/disk/by-id/scsi-1SCST_BIOfdea2076-6d3d2d29d6dd0fb2') {{(pid=86402) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49e0370-2db3-4534-bc29-8e08f8b0411e]: (4, None) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76305ed3-68dc-47cc-b222-8544e86c8c32]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c404571b-74a6-4ac8-865b-cd5afda4249d]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee, portal: 172.16.0.220,3260]
Nov 13 21:00:01 user nova-compute[75239]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee, portal: 172.16.0.220,3260] successful.
Nov 13 21:00:01 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a48c135-6bee-42b1-85f3-90fa5bb313ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21c98a2-cda6-4fe9-b5ab-3ee707e8bdd0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== disconnect_volume: return (349ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:00:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Deleting instance files /opt/stack/data/nova/instances/87359099-25a3-4c68-8242-e611db1bcc77_del
Nov 13 21:00:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Deletion of /opt/stack/data/nova/instances/87359099-25a3-4c68-8242-e611db1bcc77_del complete
Nov 13 21:00:01 user nova-compute[75239]: INFO nova.compute.manager [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 13 21:00:01 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:00:01 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:00:01 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Took 0.49 seconds to deallocate network for instance.
Nov 13 21:00:02 user nova-compute[75239]: DEBUG nova.compute.manager [req-771a7b17-878d-4cac-bd56-a4a2964bb453 req-93c0a7c2-87ca-4023-ba60-397a24b348aa service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received event network-vif-plugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:00:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-771a7b17-878d-4cac-bd56-a4a2964bb453 req-93c0a7c2-87ca-4023-ba60-397a24b348aa service nova] Acquiring lock "87359099-25a3-4c68-8242-e611db1bcc77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-771a7b17-878d-4cac-bd56-a4a2964bb453 req-93c0a7c2-87ca-4023-ba60-397a24b348aa service nova] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-771a7b17-878d-4cac-bd56-a4a2964bb453 req-93c0a7c2-87ca-4023-ba60-397a24b348aa service nova] Lock "87359099-25a3-4c68-8242-e611db1bcc77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:02 user nova-compute[75239]: DEBUG nova.compute.manager [req-771a7b17-878d-4cac-bd56-a4a2964bb453 req-93c0a7c2-87ca-4023-ba60-397a24b348aa service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] No waiting events found dispatching network-vif-plugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:00:02 user nova-compute[75239]: WARNING nova.compute.manager [req-771a7b17-878d-4cac-bd56-a4a2964bb453 req-93c0a7c2-87ca-4023-ba60-397a24b348aa service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received unexpected event network-vif-plugged-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 for instance with vm_state active and task_state deleting.
Nov 13 21:00:02 user nova-compute[75239]: DEBUG nova.compute.manager [req-771a7b17-878d-4cac-bd56-a4a2964bb453 req-93c0a7c2-87ca-4023-ba60-397a24b348aa service nova] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Received event network-vif-deleted-4f883aa8-9e95-4b3b-97ab-d7bcd2bc64b5 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:00:02 user nova-compute[75239]: INFO nova.compute.manager [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Took 1.00 seconds to detach 1 volumes for instance.
Nov 13 21:00:02 user nova-compute[75239]: DEBUG nova.compute.manager [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 87359099-25a3-4c68-8242-e611db1bcc77] Deleting volume: 9a48c135-6bee-42b1-85f3-90fa5bb313ee {{(pid=75239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 21:00:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:02 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:00:02 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:00:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:00:03 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Deleted allocations for instance 87359099-25a3-4c68-8242-e611db1bcc77
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-99636bf8-6dca-4766-8907-7e21880cc9a7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "87359099-25a3-4c68-8242-e611db1bcc77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.225s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:03 user nova-compute[75239]: INFO nova.compute.manager [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attaching volume b11ad494-70cb-4764-bbf5-9c0366cdda29 to /dev/vdb
Nov 13 21:00:03 user nova-compute[75239]: DEBUG os_brick.utils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdcfa3e-2a0c-4927-85e0-e7b344728b57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee39d91-6aea-45f1-9f55-adf08bc18971]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a05ecee-d454-4c44-93d6-06dfaec841f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0ce16a-0f15-41ea-9dc9-f918e1203cd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:00:03 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:00:03 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1981ac2-042b-4db9-9557-2de5455f60ba]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG os_brick.utils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:00:03 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating existing volume attachment record: 42481eff-246d-40ac-8041-339db3b11a13 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:00:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'giEqhXxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:00:07 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:00:07 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:00:07 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1045d2c1-1442-4080-91c9-8337036dfa40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:00:07 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca3bcb1-3886-484a-9bbf-7cbdab5a16b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29] added
Nov 13 21:00:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9c095c-b41d-41ff-a240-9e4ce55ed7ad]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f2a594-b474-4af6-a4ad-243284a958ea]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v giEqhXxy {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v giEqhXxy" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7b1c89-ee6e-4927-aaaa-51a6aa32c38c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'giEqhXxy'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b1b018-0dc9-46e6-ad7d-56ad5b4fe4b6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca895e7d-1dfa-4803-8bb4-f24d083e47bd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:00:07 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:00:07 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:00:07 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 21:00:07 user nova-compute[75239]: 
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d79537f-d6a7-4a7e-92da-ee6923fa1ab2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29, portal: 172.16.0.220,3260]
Nov 13 21:00:07 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29, portal: 172.16.0.220,3260] successful.
Nov 13 21:00:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c01e08-9c30-4fda-acab-2468f6ba3c35]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[55497a3e-69de-4be8-8959-a096af90e8ce]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 (non-flash)
Nov 13 21:00:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 (non-flash)
Nov 13 21:00:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[818d47fd-8c85-4b17-a4fd-b6d435bedd3b]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'giEqhXxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23333626432306632', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333626432306632', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG nova.objects.instance [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 21:00:09 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:00:09 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:00:09 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:00:09 user nova-compute[75239]:   <serial>b11ad494-70cb-4764-bbf5-9c0366cdda29</serial>
Nov 13 21:00:09 user nova-compute[75239]: </disk>
Nov 13 21:00:09 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] No VIF found with MAC fa:16:3e:01:c9:f0, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:00:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-6e9f27c8-e14c-4646-acbd-e914505cf541 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.250s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:11 user nova-compute[75239]: INFO nova.compute.manager [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Detaching volume b11ad494-70cb-4764-bbf5-9c0366cdda29
Nov 13 21:00:11 user nova-compute[75239]: INFO nova.virt.block_device [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Attempting to driver detach volume b11ad494-70cb-4764-bbf5-9c0366cdda29 from mountpoint /dev/vdb
Nov 13 21:00:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Attempting to detach device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 21:00:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:00:11 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:00:11 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:00:11 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:00:11 user nova-compute[75239]:   <serial>b11ad494-70cb-4764-bbf5-9c0366cdda29</serial>
Nov 13 21:00:11 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:00:11 user nova-compute[75239]: </disk>
Nov 13 21:00:11 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:00:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully detached device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the persistent domain config.
Nov 13 21:00:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 21:00:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:00:11 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:00:11 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:00:11 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:00:11 user nova-compute[75239]:   <serial>b11ad494-70cb-4764-bbf5-9c0366cdda29</serial>
Nov 13 21:00:11 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:00:11 user nova-compute[75239]: </disk>
Nov 13 21:00:11 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:00:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 21:00:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:31 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c is timed out.
Nov 13 21:00:31 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully detached device vdb from instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c from the live domain config.
Nov 13 21:00:31 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'giEqhXxy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:00:31 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:00:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8738150a-7ddc-40dc-8bab-b41d4ed319d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:00:31 user nova-compute[75239]: No targets found.
Nov 13 21:00:31 user nova-compute[75239]: iSNS:
Nov 13 21:00:31 user nova-compute[75239]: No targets found.
Nov 13 21:00:31 user nova-compute[75239]: STATIC:
Nov 13 21:00:31 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29
Nov 13 21:00:31 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:00:31 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:00:31 user nova-compute[75239]: FIRMWARE:
Nov 13 21:00:31 user nova-compute[75239]: No targets found.
Nov 13 21:00:31 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:00:31 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:00:31 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbcc862-3432-445a-97f6-7c8c8474ebae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:31 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f142b79-c7ab-4af6-ad27-390344b83ab2]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 (non-flash)
Nov 13 21:00:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 (non-flash)
Nov 13 21:00:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d602104c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e3f19f-9e34-4ab6-9ed1-f77758970fbe]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc05234-da49-43c8-be31-ac81e8222adf]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8916221a-80dc-4655-a281-b988a22d94e3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[41615888-1113-435f-b8f3-84057e75e10b]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf012ad-f922-43f3-8265-d487108278e3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf09926-ae95-4b91-8c0c-82a879231335]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29, portal: 172.16.0.220,3260]
Nov 13 21:00:32 user nova-compute[75239]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29, portal: 172.16.0.220,3260] successful.
Nov 13 21:00:32 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b11ad494-70cb-4764-bbf5-9c0366cdda29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3838533-8950-456d-9f17-573ff90670ea]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] <== disconnect_volume: return (274ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:00:32 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:00:33 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'flavor' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:00:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9aec9bd3-30ce-4233-acfb-0e152ab3ba6d tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.724s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:00:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:00:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:00:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:00:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:43 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:00:44 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:00:44 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=24.917068481445312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:00:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c0591fd1-adfd-4626-806a-a71f46c80400 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 6af4e2a4-aa89-4c03-952e-af45772ab9de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:00:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:00:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:00:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:00:48 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:00:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:00:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:00:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:00:55 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:00:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:00:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:00:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:00:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:00:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:00:56 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:00:56 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating instance_info_cache with network_info: [{"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:00:56 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:00:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 21:00:57 user nova-compute[75239]: INFO nova.compute.claims [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Claim successful on node user
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 21:00:57 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.policy [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e1458f29bb94b0abd4b75ac943fb531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc5530ef3c040dd82883043dabc4c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 21:00:57 user nova-compute[75239]: INFO nova.virt.block_device [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Booting with volume ac430472-dd70-4a78-b145-8c4d5fb80bb2 at /dev/vda
Nov 13 21:00:57 user nova-compute[75239]: DEBUG os_brick.utils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[942519b5-2ac9-4f76-bdff-e105e94b5cc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4d7c6f-45db-410a-a911-1bb14e1cf4d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[99438103-318f-40c4-8997-c64c638e3920]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c5f9e2-0c23-44aa-86a2-ba7c4300bce1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:00:57 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:00:57 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9e5d31-2ceb-42c0-8781-77578e58f2d0]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG os_brick.utils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:00:57 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updating existing volume attachment record: 60d2f25c-c0fc-4d66-a10c-8acfc65625ee {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:00:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Successfully created port: 38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 21:00:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Successfully updated port: 38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 21:00:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:00:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquired lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:00:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 21:00:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a7be439-dc12-4415-91f4-3bb2fa342438 req-60a2f9a7-54b8-40df-a59a-dd4f26bc57e9 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received event network-changed-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:00:58 user nova-compute[75239]: DEBUG nova.compute.manager [req-2a7be439-dc12-4415-91f4-3bb2fa342438 req-60a2f9a7-54b8-40df-a59a-dd4f26bc57e9 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Refreshing instance network info cache due to event network-changed-38264b39-d279-4a9d-92a4-f3e50f002a94. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:00:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a7be439-dc12-4415-91f4-3bb2fa342438 req-60a2f9a7-54b8-40df-a59a-dd4f26bc57e9 service nova] Acquiring lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:00:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 21:00:59 user nova-compute[75239]: DEBUG nova.network.neutron [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updating instance_info_cache with network_info: [{"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:00:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Releasing lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:00:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Instance network_info: |[{"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 21:00:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a7be439-dc12-4415-91f4-3bb2fa342438 req-60a2f9a7-54b8-40df-a59a-dd4f26bc57e9 service nova] Acquired lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:00:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-2a7be439-dc12-4415-91f4-3bb2fa342438 req-60a2f9a7-54b8-40df-a59a-dd4f26bc57e9 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Refreshing network info cache for port 38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:00:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-2a7be439-dc12-4415-91f4-3bb2fa342438 req-60a2f9a7-54b8-40df-a59a-dd4f26bc57e9 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updated VIF entry in instance network info cache for port 38264b39-d279-4a9d-92a4-f3e50f002a94. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:00:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-2a7be439-dc12-4415-91f4-3bb2fa342438 req-60a2f9a7-54b8-40df-a59a-dd4f26bc57e9 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updating instance_info_cache with network_info: [{"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:00:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2a7be439-dc12-4415-91f4-3bb2fa342438 req-60a2f9a7-54b8-40df-a59a-dd4f26bc57e9 service nova] Releasing lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:01:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 21:01:01 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Creating image(s)
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Ensure instance console log exists: /opt/stack/data/nova/instances/ffadc6ad-5f7c-481c-ba84-07a7676869aa/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Start _get_guest_xml network_info=[{"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '60d2f25c-c0fc-4d66-a10c-8acfc65625ee', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAMxQupf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ffadc6ad-5f7c-481c-ba84-07a7676869aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac430472-dd70-4a78-b145-8c4d5fb80bb2', 'serial': 'ac430472-dd70-4a78-b145-8c4d5fb80bb2'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 21:01:01 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:01:01 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAMxQupf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:01:01 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:01:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:01:01 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:01:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:01:01 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:01:01 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:01:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafbd859-18d7-49be-8cfa-dd3bfbd36e52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:01:02 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[415656f9-1730-4f59-b556-b22b0ace4bad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2] added
Nov 13 21:01:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.050s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[840ab0b8-1d82-4a3d-94ff-35cdde4eb75b]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a06d55a-59b3-459f-888b-facd78900cf9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAMxQupf {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dAMxQupf" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[090f9cd7-1e26-4d5f-9347-cc7f55bd8807]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dAMxQupf'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4083ff71-d492-467b-9608-851c5be1b74f]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e2e6c8-c9f2-4ca9-bd32-2ebfb90b6ef4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:01:02 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:01:02 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:01:02 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 21:01:02 user nova-compute[75239]: 
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1fd910-3696-44ca-91b5-857154e170bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2, portal: 172.16.0.220,3260]
Nov 13 21:01:02 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2, portal: 172.16.0.220,3260] successful.
Nov 13 21:01:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0459ab07-ffc5-4cd9-9aaf-5af005e97414]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a50a2a4-93a6-45b4-b5f1-168078549d85]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:01:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:01:02 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf880e4-a6f6-4d7f-b5e0-6d00606ad843]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:02 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAMxQupf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23031346630613766', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031346630613766', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-91555584',display_name='tempest-TestVolumeBootPattern-volume-backed-server-91555584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-91555584',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8JpeFahu5SJVQ89A1xpuY8IGus/gZkaGElU0UCsLCEFOe1Q9rtsyk3SFdJQuwhFZrpTHx0fKVfqkaslVR+f3Ct/uSQ8rI/a4AbeT+ffCvtHo2zqOiIKDwBTsX5TiAWNw==',key_name='tempest-keypair-2131526261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-23iz07d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:00:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=ffadc6ad-5f7c-481c-ba84-07a7676869aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:97:e2,bridge_name='br-int',has_traffic_filtering=True,id=38264b39-d279-4a9d-92a4-f3e50f002a94,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38264b39-d2') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.objects.instance [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'pci_devices' on Instance uuid ffadc6ad-5f7c-481c-ba84-07a7676869aa {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 21:01:03 user nova-compute[75239]:   <uuid>ffadc6ad-5f7c-481c-ba84-07a7676869aa</uuid>
Nov 13 21:01:03 user nova-compute[75239]:   <name>instance-00000030</name>
Nov 13 21:01:03 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 21:01:03 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 21:01:03 user nova-compute[75239]:   <metadata>
Nov 13 21:01:03 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 21:01:03 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 21:01:03 user nova-compute[75239]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-91555584</nova:name>
Nov 13 21:01:03 user nova-compute[75239]:       <nova:creationTime>2023-11-13 21:01:01</nova:creationTime>
Nov 13 21:01:03 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 21:01:03 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 21:01:03 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 21:01:03 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 21:01:03 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 21:01:03 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 21:01:03 user nova-compute[75239]:       </nova:flavor>
Nov 13 21:01:03 user nova-compute[75239]:       <nova:owner>
Nov 13 21:01:03 user nova-compute[75239]:         <nova:user uuid="7e1458f29bb94b0abd4b75ac943fb531">tempest-TestVolumeBootPattern-1828724263-project-member</nova:user>
Nov 13 21:01:03 user nova-compute[75239]:         <nova:project uuid="fbc5530ef3c040dd82883043dabc4c7d">tempest-TestVolumeBootPattern-1828724263</nova:project>
Nov 13 21:01:03 user nova-compute[75239]:       </nova:owner>
Nov 13 21:01:03 user nova-compute[75239]:       <nova:ports>
Nov 13 21:01:03 user nova-compute[75239]:         <nova:port uuid="38264b39-d279-4a9d-92a4-f3e50f002a94">
Nov 13 21:01:03 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 21:01:03 user nova-compute[75239]:         </nova:port>
Nov 13 21:01:03 user nova-compute[75239]:       </nova:ports>
Nov 13 21:01:03 user nova-compute[75239]:     </nova:instance>
Nov 13 21:01:03 user nova-compute[75239]:   </metadata>
Nov 13 21:01:03 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 21:01:03 user nova-compute[75239]:     <system>
Nov 13 21:01:03 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 21:01:03 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 21:01:03 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 21:01:03 user nova-compute[75239]:       <entry name="serial">ffadc6ad-5f7c-481c-ba84-07a7676869aa</entry>
Nov 13 21:01:03 user nova-compute[75239]:       <entry name="uuid">ffadc6ad-5f7c-481c-ba84-07a7676869aa</entry>
Nov 13 21:01:03 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 21:01:03 user nova-compute[75239]:     </system>
Nov 13 21:01:03 user nova-compute[75239]:   </sysinfo>
Nov 13 21:01:03 user nova-compute[75239]:   <os>
Nov 13 21:01:03 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 21:01:03 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 21:01:03 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 21:01:03 user nova-compute[75239]:   </os>
Nov 13 21:01:03 user nova-compute[75239]:   <features>
Nov 13 21:01:03 user nova-compute[75239]:     <acpi/>
Nov 13 21:01:03 user nova-compute[75239]:     <apic/>
Nov 13 21:01:03 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 21:01:03 user nova-compute[75239]:   </features>
Nov 13 21:01:03 user nova-compute[75239]:   <clock offset="utc">
Nov 13 21:01:03 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 21:01:03 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 21:01:03 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 21:01:03 user nova-compute[75239]:   </clock>
Nov 13 21:01:03 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 21:01:03 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 21:01:03 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 21:01:03 user nova-compute[75239]:   </cpu>
Nov 13 21:01:03 user nova-compute[75239]:   <devices>
Nov 13 21:01:03 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 21:01:03 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:01:03 user nova-compute[75239]:       <source dev="/dev/sdb"/>
Nov 13 21:01:03 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 21:01:03 user nova-compute[75239]:       <serial>ac430472-dd70-4a78-b145-8c4d5fb80bb2</serial>
Nov 13 21:01:03 user nova-compute[75239]:     </disk>
Nov 13 21:01:03 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 21:01:03 user nova-compute[75239]:       <mac address="fa:16:3e:23:97:e2"/>
Nov 13 21:01:03 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:01:03 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 21:01:03 user nova-compute[75239]:       <target dev="tap38264b39-d2"/>
Nov 13 21:01:03 user nova-compute[75239]:     </interface>
Nov 13 21:01:03 user nova-compute[75239]:     <serial type="pty">
Nov 13 21:01:03 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/ffadc6ad-5f7c-481c-ba84-07a7676869aa/console.log" append="off"/>
Nov 13 21:01:03 user nova-compute[75239]:     </serial>
Nov 13 21:01:03 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 21:01:03 user nova-compute[75239]:     <video>
Nov 13 21:01:03 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:01:03 user nova-compute[75239]:     </video>
Nov 13 21:01:03 user nova-compute[75239]:     <rng model="virtio">
Nov 13 21:01:03 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 21:01:03 user nova-compute[75239]:     </rng>
Nov 13 21:01:03 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 21:01:03 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 21:01:03 user nova-compute[75239]:       <stats period="10"/>
Nov 13 21:01:03 user nova-compute[75239]:     </memballoon>
Nov 13 21:01:03 user nova-compute[75239]:   </devices>
Nov 13 21:01:03 user nova-compute[75239]: </domain>
Nov 13 21:01:03 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-91555584',display_name='tempest-TestVolumeBootPattern-volume-backed-server-91555584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-91555584',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8JpeFahu5SJVQ89A1xpuY8IGus/gZkaGElU0UCsLCEFOe1Q9rtsyk3SFdJQuwhFZrpTHx0fKVfqkaslVR+f3Ct/uSQ8rI/a4AbeT+ffCvtHo2zqOiIKDwBTsX5TiAWNw==',key_name='tempest-keypair-2131526261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-23iz07d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:00:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=ffadc6ad-5f7c-481c-ba84-07a7676869aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:97:e2,bridge_name='br-int',has_traffic_filtering=True,id=38264b39-d279-4a9d-92a4-f3e50f002a94,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38264b39-d2') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG os_vif [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:97:e2,bridge_name='br-int',has_traffic_filtering=True,id=38264b39-d279-4a9d-92a4-f3e50f002a94,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38264b39-d2') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '860802e1-3043-5ad0-ba13-dba7210695cb', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38264b39-d2, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38264b39-d2, col_values=(('qos', UUID('83f11ddf-4cf4-452b-acdc-ba04a5f047ee')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38264b39-d2, col_values=(('external_ids', {'iface-id': '38264b39-d279-4a9d-92a4-f3e50f002a94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:97:e2', 'vm-uuid': 'ffadc6ad-5f7c-481c-ba84-07a7676869aa'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:03 user nova-compute[75239]: INFO os_vif [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:97:e2,bridge_name='br-int',has_traffic_filtering=True,id=38264b39-d279-4a9d-92a4-f3e50f002a94,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38264b39-d2')
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:01:03 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No VIF found with MAC fa:16:3e:23:97:e2, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:01:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-b4753c02-6d28-4553-ac93-a6bbad2e91f7 req-d179ddeb-c675-4a26-8282-03d8fadddfd6 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received event network-vif-plugged-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:01:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b4753c02-6d28-4553-ac93-a6bbad2e91f7 req-d179ddeb-c675-4a26-8282-03d8fadddfd6 service nova] Acquiring lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b4753c02-6d28-4553-ac93-a6bbad2e91f7 req-d179ddeb-c675-4a26-8282-03d8fadddfd6 service nova] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b4753c02-6d28-4553-ac93-a6bbad2e91f7 req-d179ddeb-c675-4a26-8282-03d8fadddfd6 service nova] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:04 user nova-compute[75239]: DEBUG nova.compute.manager [req-b4753c02-6d28-4553-ac93-a6bbad2e91f7 req-d179ddeb-c675-4a26-8282-03d8fadddfd6 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] No waiting events found dispatching network-vif-plugged-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:01:04 user nova-compute[75239]: WARNING nova.compute.manager [req-b4753c02-6d28-4553-ac93-a6bbad2e91f7 req-d179ddeb-c675-4a26-8282-03d8fadddfd6 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received unexpected event network-vif-plugged-38264b39-d279-4a9d-92a4-f3e50f002a94 for instance with vm_state building and task_state spawning.
Nov 13 21:01:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:01:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "c0591fd1-adfd-4626-806a-a71f46c80400" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "c0591fd1-adfd-4626-806a-a71f46c80400" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:06 user nova-compute[75239]: INFO nova.compute.manager [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Terminating instance
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:06 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Instance destroyed successfully.
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.objects.instance [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lazy-loading 'resources' on Instance uuid c0591fd1-adfd-4626-806a-a71f46c80400 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:52:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1213810461',display_name='tempest-ServersNegativeTestJSON-server-1213810461',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1213810461',id=39,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:52:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='617b57945a52486a96a05958d9850e06',ramdisk_id='',reservation_id='r-ewiopi0f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-462526943',owner_user_name='tempest-ServersNegativeTestJSON-462526943-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:52:33Z,user_data=None,user_id='e79a6935af1f47cebd04dcb0ec9e487e',uuid=c0591fd1-adfd-4626-806a-a71f46c80400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converting VIF {"id": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "address": "fa:16:3e:9e:17:f4", "network": {"id": "13e00d01-f894-4393-abce-517da33aa56f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1946741641-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "617b57945a52486a96a05958d9850e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapacf81d52-e4", "ovs_interfaceid": "acf81d52-e4ae-4c10-b0c3-7874a29f13b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:17:f4,bridge_name='br-int',has_traffic_filtering=True,id=acf81d52-e4ae-4c10-b0c3-7874a29f13b8,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf81d52-e4') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG os_vif [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:17:f4,bridge_name='br-int',has_traffic_filtering=True,id=acf81d52-e4ae-4c10-b0c3-7874a29f13b8,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf81d52-e4') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapacf81d52-e4, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f1d6f62-df83-474e-a79d-3ed7d848e2e2) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:01:06 user nova-compute[75239]: INFO os_vif [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:17:f4,bridge_name='br-int',has_traffic_filtering=True,id=acf81d52-e4ae-4c10-b0c3-7874a29f13b8,network=Network(13e00d01-f894-4393-abce-517da33aa56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapacf81d52-e4')
Nov 13 21:01:06 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Deleting instance files /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400_del
Nov 13 21:01:06 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Deletion of /opt/stack/data/nova/instances/c0591fd1-adfd-4626-806a-a71f46c80400_del complete
Nov 13 21:01:06 user nova-compute[75239]: INFO nova.compute.manager [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 21:01:06 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Instance spawned successfully.
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received event network-vif-plugged-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] Acquiring lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] No waiting events found dispatching network-vif-plugged-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:01:06 user nova-compute[75239]: WARNING nova.compute.manager [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received unexpected event network-vif-plugged-38264b39-d279-4a9d-92a4-f3e50f002a94 for instance with vm_state building and task_state spawning.
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received event network-vif-unplugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] Acquiring lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] No waiting events found dispatching network-vif-unplugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received event network-vif-unplugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received event network-vif-plugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] Acquiring lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] Lock "c0591fd1-adfd-4626-806a-a71f46c80400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] No waiting events found dispatching network-vif-plugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:01:06 user nova-compute[75239]: WARNING nova.compute.manager [req-e239ee2d-ecac-41ca-92ab-a51295242994 req-0e26b4d9-0abf-42b0-bdfb-08711ce4f03b service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received unexpected event network-vif-plugged-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 for instance with vm_state active and task_state deleting.
Nov 13 21:01:07 user nova-compute[75239]: INFO nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 13 21:01:07 user nova-compute[75239]: DEBUG nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 21:01:07 user nova-compute[75239]: INFO nova.compute.manager [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Took 9.94 seconds to build instance.
Nov 13 21:01:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-fcfc17b5-b66b-41bd-9cef-077d6394387a tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.035s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:07 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:01:07 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Took 0.43 seconds to deallocate network for instance.
Nov 13 21:01:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-a49b4b58-8156-4954-9676-50267ae6bdbf req-cfea0a2e-9405-4540-9f6c-b781882d697a service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Received event network-vif-deleted-acf81d52-e4ae-4c10-b0c3-7874a29f13b8 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:01:07 user nova-compute[75239]: INFO nova.compute.manager [req-a49b4b58-8156-4954-9676-50267ae6bdbf req-cfea0a2e-9405-4540-9f6c-b781882d697a service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Neutron deleted interface acf81d52-e4ae-4c10-b0c3-7874a29f13b8; detaching it from the instance and deleting it from the info cache
Nov 13 21:01:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-a49b4b58-8156-4954-9676-50267ae6bdbf req-cfea0a2e-9405-4540-9f6c-b781882d697a service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:01:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-a49b4b58-8156-4954-9676-50267ae6bdbf req-cfea0a2e-9405-4540-9f6c-b781882d697a service nova] [instance: c0591fd1-adfd-4626-806a-a71f46c80400] Detach interface failed, port_id=acf81d52-e4ae-4c10-b0c3-7874a29f13b8, reason: Instance c0591fd1-adfd-4626-806a-a71f46c80400 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 21:01:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:07 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:01:07 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:01:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:07 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Deleted allocations for instance c0591fd1-adfd-4626-806a-a71f46c80400
Nov 13 21:01:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-5cec370c-df3d-4cb9-958e-9f562d7fba76 tempest-ServersNegativeTestJSON-462526943 tempest-ServersNegativeTestJSON-462526943-project-member] Lock "c0591fd1-adfd-4626-806a-a71f46c80400" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.480s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:10 user nova-compute[75239]: INFO nova.compute.manager [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Terminating instance
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.compute.manager [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-6f4cff2a-0508-4aa6-966d-74e53c28c714 req-9cfdbea6-a645-4eeb-a906-177195ff45c4 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received event network-vif-unplugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6f4cff2a-0508-4aa6-966d-74e53c28c714 req-9cfdbea6-a645-4eeb-a906-177195ff45c4 service nova] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6f4cff2a-0508-4aa6-966d-74e53c28c714 req-9cfdbea6-a645-4eeb-a906-177195ff45c4 service nova] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-6f4cff2a-0508-4aa6-966d-74e53c28c714 req-9cfdbea6-a645-4eeb-a906-177195ff45c4 service nova] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-6f4cff2a-0508-4aa6-966d-74e53c28c714 req-9cfdbea6-a645-4eeb-a906-177195ff45c4 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] No waiting events found dispatching network-vif-unplugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.compute.manager [req-6f4cff2a-0508-4aa6-966d-74e53c28c714 req-9cfdbea6-a645-4eeb-a906-177195ff45c4 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received event network-vif-unplugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:01:10 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Instance destroyed successfully.
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.objects.instance [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lazy-loading 'resources' on Instance uuid a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:55:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1633693772',display_name='tempest-SnapshotDataIntegrityTests-server-1633693772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1633693772',id=43,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5Wwjpn9UBw8N17A5znuv1GYP5BlsCMqohnhm1y8uEWdhyPsApBegcvAG8y083Bceg7hOQ36rMRAc4MV7rYQ4g8mYUzk7tp50HT06jKH6evFmDJoA5zhpVXEuQ3+CzIkg==',key_name='tempest-keypair-88762707',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:55:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52bf0396a2c344cd818be8120ecaa5cb',ramdisk_id='',reservation_id='r-54p7zsz3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1386629735',owner_user_name='tempest-SnapshotDataIntegrityTests-1386629735-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74903f6cc0014ec89048e94ef4c6ba9e',uuid=a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Converting VIF {"id": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "address": "fa:16:3e:01:c9:f0", "network": {"id": "b06f2285-1028-4613-b7cd-0e8f2bb58507", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-559291705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52bf0396a2c344cd818be8120ecaa5cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6a43c21-a3", "ovs_interfaceid": "e6a43c21-a34e-4c66-9a7c-65de4df750b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:c9:f0,bridge_name='br-int',has_traffic_filtering=True,id=e6a43c21-a34e-4c66-9a7c-65de4df750b2,network=Network(b06f2285-1028-4613-b7cd-0e8f2bb58507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a43c21-a3') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG os_vif [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:c9:f0,bridge_name='br-int',has_traffic_filtering=True,id=e6a43c21-a34e-4c66-9a7c-65de4df750b2,network=Network(b06f2285-1028-4613-b7cd-0e8f2bb58507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a43c21-a3') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6a43c21-a3, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74054b94-d93d-4286-9d79-c85a310f8520) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:01:10 user nova-compute[75239]: INFO os_vif [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:c9:f0,bridge_name='br-int',has_traffic_filtering=True,id=e6a43c21-a34e-4c66-9a7c-65de4df750b2,network=Network(b06f2285-1028-4613-b7cd-0e8f2bb58507),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6a43c21-a3')
Nov 13 21:01:10 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Deleting instance files /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c_del
Nov 13 21:01:10 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Deletion of /opt/stack/data/nova/instances/a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c_del complete
Nov 13 21:01:10 user nova-compute[75239]: INFO nova.compute.manager [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 21:01:10 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:01:10 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:01:11 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:01:11 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Took 0.66 seconds to deallocate network for instance.
Nov 13 21:01:11 user nova-compute[75239]: DEBUG nova.compute.manager [req-34bd66b6-a86c-45b2-a9ec-2cb5d9353783 req-e8b5677d-3df4-4879-8d07-24dad9a26e15 service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received event network-vif-deleted-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:01:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:11 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:01:11 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:01:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:11 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Deleted allocations for instance a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c
Nov 13 21:01:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-2d24c918-a284-4127-93c9-7776c5aa5095 tempest-SnapshotDataIntegrityTests-1386629735 tempest-SnapshotDataIntegrityTests-1386629735-project-member] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.889s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-c189f837-839b-48f4-84ec-9b0d3d205fd9 req-4abb7981-4b77-4325-b7c5-d8adabb12fdc service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received event network-vif-plugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:01:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c189f837-839b-48f4-84ec-9b0d3d205fd9 req-4abb7981-4b77-4325-b7c5-d8adabb12fdc service nova] Acquiring lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c189f837-839b-48f4-84ec-9b0d3d205fd9 req-4abb7981-4b77-4325-b7c5-d8adabb12fdc service nova] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c189f837-839b-48f4-84ec-9b0d3d205fd9 req-4abb7981-4b77-4325-b7c5-d8adabb12fdc service nova] Lock "a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:12 user nova-compute[75239]: DEBUG nova.compute.manager [req-c189f837-839b-48f4-84ec-9b0d3d205fd9 req-4abb7981-4b77-4325-b7c5-d8adabb12fdc service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] No waiting events found dispatching network-vif-plugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:01:12 user nova-compute[75239]: WARNING nova.compute.manager [req-c189f837-839b-48f4-84ec-9b0d3d205fd9 req-4abb7981-4b77-4325-b7c5-d8adabb12fdc service nova] [instance: a8ca1c3e-ce61-4b27-9466-0cc9c4b9562c] Received unexpected event network-vif-plugged-e6a43c21-a34e-4c66-9a7c-65de4df750b2 for instance with vm_state deleted and task_state None.
Nov 13 21:01:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:01:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-61b7b900-7035-4503-aba3-c179951e9afb req-93c2b6a2-620c-4c07-bb9d-1aca657d8b72 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received event network-changed-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:01:42 user nova-compute[75239]: DEBUG nova.compute.manager [req-61b7b900-7035-4503-aba3-c179951e9afb req-93c2b6a2-620c-4c07-bb9d-1aca657d8b72 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Refreshing instance network info cache due to event network-changed-f8858bfb-493f-43aa-9dba-69fbd6816924. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:01:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-61b7b900-7035-4503-aba3-c179951e9afb req-93c2b6a2-620c-4c07-bb9d-1aca657d8b72 service nova] Acquiring lock "refresh_cache-6af4e2a4-aa89-4c03-952e-af45772ab9de" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:01:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-61b7b900-7035-4503-aba3-c179951e9afb req-93c2b6a2-620c-4c07-bb9d-1aca657d8b72 service nova] Acquired lock "refresh_cache-6af4e2a4-aa89-4c03-952e-af45772ab9de" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:01:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-61b7b900-7035-4503-aba3-c179951e9afb req-93c2b6a2-620c-4c07-bb9d-1aca657d8b72 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Refreshing network info cache for port f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:01:43 user nova-compute[75239]: DEBUG nova.network.neutron [req-61b7b900-7035-4503-aba3-c179951e9afb req-93c2b6a2-620c-4c07-bb9d-1aca657d8b72 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Updated VIF entry in instance network info cache for port f8858bfb-493f-43aa-9dba-69fbd6816924. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:01:43 user nova-compute[75239]: DEBUG nova.network.neutron [req-61b7b900-7035-4503-aba3-c179951e9afb req-93c2b6a2-620c-4c07-bb9d-1aca657d8b72 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Updating instance_info_cache with network_info: [{"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:01:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-61b7b900-7035-4503-aba3-c179951e9afb req-93c2b6a2-620c-4c07-bb9d-1aca657d8b72 service nova] Releasing lock "refresh_cache-6af4e2a4-aa89-4c03-952e-af45772ab9de" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:01:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG nova.objects.instance [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'flavor' on Instance uuid 6af4e2a4-aa89-4c03-952e-af45772ab9de {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:44 user nova-compute[75239]: INFO nova.compute.manager [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Attaching volume d35e1fc5-5fce-43bd-82d3-cbd246569e66 to /dev/vdb
Nov 13 21:01:44 user nova-compute[75239]: DEBUG os_brick.utils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e286eb-905e-4b81-a3ee-7058bace26e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[499f150b-bff9-4fd4-8926-0f6c915413f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4084d8a4-6cfc-40ff-bf48-6f1720bb390b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cf7cd8-3750-4f58-add5-aefdc24918fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:01:44 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:01:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1394e8-7043-4bea-bb23-74b71c35b40f]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG os_brick.utils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:01:44 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Updating existing volume attachment record: e81a481a-b98c-485b-ba4d-10284fa6aaaf {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:46 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:01:46 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:01:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=24.962459564208984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 6af4e2a4-aa89-4c03-952e-af45772ab9de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ffadc6ad-5f7c-481c-ba84-07a7676869aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:01:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.216s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQlNkJFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:01:48 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:01:48 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:01:48 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3c1be9-b52f-470a-a90c-133817cf2edb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:01:48 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a471b3-91ec-4f65-ae9a-f444a2442cc7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66] added
Nov 13 21:01:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[38257910-0087-4758-9c7e-67554e5ec83a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e2ccdd-c882-4835-839c-2935772a3a42]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQlNkJFI {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQlNkJFI" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80997f7-d6f6-4c8b-874c-44a5c0b638c1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nQlNkJFI'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af664ac-9456-480e-8c0f-e680c09cd5ff]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2351eda-bf9f-4383-a697-2b86dfd853f3]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:01:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:01:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb71282-b683-45cf-907f-0ce97a6578e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66, portal: 172.16.0.220,3260]
Nov 13 21:01:48 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66, portal: 172.16.0.220,3260] successful.
Nov 13 21:01:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11205dd-647a-4525-863d-f957a52f77ec]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fff3c1e-4edd-46a7-a10c-4ffe81e4a1ce]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:01:48 user nova-compute[75239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 (non-flash)
Nov 13 21:01:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:01:48 user nova-compute[75239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 (non-flash)
Nov 13 21:01:48 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfcc22c-fe5f-4859-a70b-9b35c06030ee]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:01:48 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:01:49 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:01:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQlNkJFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:01:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:01:49 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26163303164356137', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:01:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163303164356137', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:01:49 user nova-compute[75239]: DEBUG nova.objects.instance [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'flavor' on Instance uuid 6af4e2a4-aa89-4c03-952e-af45772ab9de {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:01:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 21:01:49 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:01:49 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 21:01:49 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:01:49 user nova-compute[75239]:   <serial>d35e1fc5-5fce-43bd-82d3-cbd246569e66</serial>
Nov 13 21:01:49 user nova-compute[75239]: </disk>
Nov 13 21:01:49 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 21:01:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:01:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:01:50 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] No VIF found with MAC fa:16:3e:f4:55:83, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:01:50 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:01:50 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:01:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-f9e804fc-8e71-48a2-ba57-009cca8a69d6 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.843s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:01:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:01:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:01:51 user nova-compute[75239]: INFO nova.compute.manager [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Detaching volume d35e1fc5-5fce-43bd-82d3-cbd246569e66
Nov 13 21:01:51 user nova-compute[75239]: INFO nova.virt.block_device [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Attempting to driver detach volume d35e1fc5-5fce-43bd-82d3-cbd246569e66 from mountpoint /dev/vdb
Nov 13 21:01:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Attempting to detach device vdb from instance 6af4e2a4-aa89-4c03-952e-af45772ab9de from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 21:01:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:01:51 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:01:51 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 21:01:51 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:01:51 user nova-compute[75239]:   <serial>d35e1fc5-5fce-43bd-82d3-cbd246569e66</serial>
Nov 13 21:01:51 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:01:51 user nova-compute[75239]: </disk>
Nov 13 21:01:51 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:01:51 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully detached device vdb from instance 6af4e2a4-aa89-4c03-952e-af45772ab9de from the persistent domain config.
Nov 13 21:01:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6af4e2a4-aa89-4c03-952e-af45772ab9de from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 21:01:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:01:51 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:01:51 user nova-compute[75239]:   <source dev="/dev/sdc"/>
Nov 13 21:01:51 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:01:51 user nova-compute[75239]:   <serial>d35e1fc5-5fce-43bd-82d3-cbd246569e66</serial>
Nov 13 21:01:51 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:01:51 user nova-compute[75239]: </disk>
Nov 13 21:01:51 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:01:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6af4e2a4-aa89-4c03-952e-af45772ab9de {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 21:01:52 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:01:52 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:01:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:01:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:58 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:01:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:01:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 21:01:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:01:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:11 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6af4e2a4-aa89-4c03-952e-af45772ab9de is timed out.
Nov 13 21:02:11 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully detached device vdb from instance 6af4e2a4-aa89-4c03-952e-af45772ab9de from the live domain config.
Nov 13 21:02:11 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQlNkJFI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:02:11 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb244a0-0705-4040-8561-6df6d32d7f65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:02:11 user nova-compute[75239]: No targets found.
Nov 13 21:02:11 user nova-compute[75239]: iSNS:
Nov 13 21:02:11 user nova-compute[75239]: No targets found.
Nov 13 21:02:11 user nova-compute[75239]: STATIC:
Nov 13 21:02:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2
Nov 13 21:02:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:02:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:02:11 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66
Nov 13 21:02:11 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:02:11 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:02:11 user nova-compute[75239]: FIRMWARE:
Nov 13 21:02:11 user nova-compute[75239]: No targets found.
Nov 13 21:02:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:02:11 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:02:11 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a00df25-e4f3-4687-b13e-7900694ef37f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2806229b-e3c6-4266-95a0-a766e960d0d6]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:02:11 user nova-compute[75239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 (non-flash)
Nov 13 21:02:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:02:11 user nova-compute[75239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 (non-flash)
Nov 13 21:02:11 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60416e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb41f82-b495-4923-b647-cfe537f31a24]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8e54aa-2047-466e-b52f-4b81c72043e0]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c5160d-9c02-4c62-a04b-66010ecc4200]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:02:11 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d32591c-9b7b-408e-9776-bf51cc2c92d4]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aef7e3-bcd2-45ec-ae20-ac9730d86c60]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35d857a-33e9-403c-a5f1-fbc727491f55]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66, portal: 172.16.0.220,3260]
Nov 13 21:02:12 user nova-compute[75239]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66, portal: 172.16.0.220,3260] successful.
Nov 13 21:02:12 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35e1fc5-5fce-43bd-82d3-cbd246569e66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[94db6303-1a19-46d3-90b0-0f61ee1dcfed]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] <== disconnect_volume: return (300ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG nova.objects.instance [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'flavor' on Instance uuid 6af4e2a4-aa89-4c03-952e-af45772ab9de {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:02:12 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-4bb0e2bd-40cb-4941-8103-d19360f59120 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.582s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:02:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:02:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:02:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:02:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:02:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:02:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:02:41 user nova-compute[75239]: INFO nova.compute.manager [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Terminating instance
Nov 13 21:02:41 user nova-compute[75239]: DEBUG nova.compute.manager [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-c63302f4-ade3-4b60-8143-363370d3a91e req-4d90b9ad-7d65-49ba-b2b5-abc1f9d43a36 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received event network-vif-unplugged-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c63302f4-ade3-4b60-8143-363370d3a91e req-4d90b9ad-7d65-49ba-b2b5-abc1f9d43a36 service nova] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c63302f4-ade3-4b60-8143-363370d3a91e req-4d90b9ad-7d65-49ba-b2b5-abc1f9d43a36 service nova] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c63302f4-ade3-4b60-8143-363370d3a91e req-4d90b9ad-7d65-49ba-b2b5-abc1f9d43a36 service nova] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-c63302f4-ade3-4b60-8143-363370d3a91e req-4d90b9ad-7d65-49ba-b2b5-abc1f9d43a36 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] No waiting events found dispatching network-vif-unplugged-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:02:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-c63302f4-ade3-4b60-8143-363370d3a91e req-4d90b9ad-7d65-49ba-b2b5-abc1f9d43a36 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received event network-vif-unplugged-f8858bfb-493f-43aa-9dba-69fbd6816924 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:02:42 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Instance destroyed successfully.
Nov 13 21:02:42 user nova-compute[75239]: DEBUG nova.objects.instance [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lazy-loading 'resources' on Instance uuid 6af4e2a4-aa89-4c03-952e-af45772ab9de {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T20:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-418133690',display_name='tempest-AttachVolumeNegativeTest-server-418133690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-418133690',id=47,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJsRWLVB+ruDpelPqY4bDMAOq68pMZ7JnHs/bqx8e3lqgTLV+8YkGzkgBOLESYJjfAwGAfirRSYT7ncaTsQAcxKQUjPNnELsisTB2+4tx9i7+m9EPbXzDiVWFvz9GNYzQ==',key_name='tempest-keypair-1741528995',keypairs=<?>,launch_index=0,launched_at=2023-11-13T20:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f422c15f5d0d4a62ad37feabca7faa03',ramdisk_id='',reservation_id='r-n6eqob0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1236383897',owner_user_name='tempest-AttachVolumeNegativeTest-1236383897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T20:59:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fa7ce2c9a26e403d9d802d354b43e8e7',uuid=6af4e2a4-aa89-4c03-952e-af45772ab9de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converting VIF {"id": "f8858bfb-493f-43aa-9dba-69fbd6816924", "address": "fa:16:3e:f4:55:83", "network": {"id": "599ba4fc-4306-448c-bf0d-20282f30894a", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1583407178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f422c15f5d0d4a62ad37feabca7faa03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8858bfb-49", "ovs_interfaceid": "f8858bfb-493f-43aa-9dba-69fbd6816924", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:55:83,bridge_name='br-int',has_traffic_filtering=True,id=f8858bfb-493f-43aa-9dba-69fbd6816924,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8858bfb-49') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG os_vif [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:55:83,bridge_name='br-int',has_traffic_filtering=True,id=f8858bfb-493f-43aa-9dba-69fbd6816924,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8858bfb-49') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8858bfb-49, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6a66d25-f098-4df9-9ff2-d62d407d0872) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:02:42 user nova-compute[75239]: INFO os_vif [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:55:83,bridge_name='br-int',has_traffic_filtering=True,id=f8858bfb-493f-43aa-9dba-69fbd6816924,network=Network(599ba4fc-4306-448c-bf0d-20282f30894a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8858bfb-49')
Nov 13 21:02:42 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Deleting instance files /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de_del
Nov 13 21:02:42 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Deletion of /opt/stack/data/nova/instances/6af4e2a4-aa89-4c03-952e-af45772ab9de_del complete
Nov 13 21:02:42 user nova-compute[75239]: INFO nova.compute.manager [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 21:02:42 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:02:42 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:02:43 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:02:43 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Took 1.07 seconds to deallocate network for instance.
Nov 13 21:02:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-55b02d90-f559-46ae-aedd-802cf7a41487 req-57435f20-0baa-4148-869a-53f820a4c457 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received event network-vif-deleted-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:02:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:02:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:02:43 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:02:43 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:02:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:02:43 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Deleted allocations for instance 6af4e2a4-aa89-4c03-952e-af45772ab9de
Nov 13 21:02:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-8f2464be-51d3-4aef-baa0-b394c3627539 tempest-AttachVolumeNegativeTest-1236383897 tempest-AttachVolumeNegativeTest-1236383897-project-member] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.306s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:02:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-fe8673ce-50ec-4103-b6a5-c19f94c3d13c req-121f3a2a-6a48-4bff-88af-ad07b200c709 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received event network-vif-plugged-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:02:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe8673ce-50ec-4103-b6a5-c19f94c3d13c req-121f3a2a-6a48-4bff-88af-ad07b200c709 service nova] Acquiring lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:02:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe8673ce-50ec-4103-b6a5-c19f94c3d13c req-121f3a2a-6a48-4bff-88af-ad07b200c709 service nova] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:02:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fe8673ce-50ec-4103-b6a5-c19f94c3d13c req-121f3a2a-6a48-4bff-88af-ad07b200c709 service nova] Lock "6af4e2a4-aa89-4c03-952e-af45772ab9de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:02:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-fe8673ce-50ec-4103-b6a5-c19f94c3d13c req-121f3a2a-6a48-4bff-88af-ad07b200c709 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] No waiting events found dispatching network-vif-plugged-f8858bfb-493f-43aa-9dba-69fbd6816924 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:02:44 user nova-compute[75239]: WARNING nova.compute.manager [req-fe8673ce-50ec-4103-b6a5-c19f94c3d13c req-121f3a2a-6a48-4bff-88af-ad07b200c709 service nova] [instance: 6af4e2a4-aa89-4c03-952e-af45772ab9de] Received unexpected event network-vif-plugged-f8858bfb-493f-43aa-9dba-69fbd6816924 for instance with vm_state deleted and task_state None.
Nov 13 21:02:45 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:02:45 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:02:45 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:02:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=24.98632049560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ffadc6ad-5f7c-481c-ba84-07a7676869aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:02:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:02:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:02:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-eaca31aa-157a-4020-a6e6-1a7f1bf7e1bc req-30f9582a-c422-4473-8f53-57f2a3ea1dfb service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received event network-changed-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:02:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-eaca31aa-157a-4020-a6e6-1a7f1bf7e1bc req-30f9582a-c422-4473-8f53-57f2a3ea1dfb service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Refreshing instance network info cache due to event network-changed-38264b39-d279-4a9d-92a4-f3e50f002a94. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:02:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-eaca31aa-157a-4020-a6e6-1a7f1bf7e1bc req-30f9582a-c422-4473-8f53-57f2a3ea1dfb service nova] Acquiring lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:02:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-eaca31aa-157a-4020-a6e6-1a7f1bf7e1bc req-30f9582a-c422-4473-8f53-57f2a3ea1dfb service nova] Acquired lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:02:47 user nova-compute[75239]: DEBUG nova.network.neutron [req-eaca31aa-157a-4020-a6e6-1a7f1bf7e1bc req-30f9582a-c422-4473-8f53-57f2a3ea1dfb service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Refreshing network info cache for port 38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:02:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-eaca31aa-157a-4020-a6e6-1a7f1bf7e1bc req-30f9582a-c422-4473-8f53-57f2a3ea1dfb service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updated VIF entry in instance network info cache for port 38264b39-d279-4a9d-92a4-f3e50f002a94. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:02:48 user nova-compute[75239]: DEBUG nova.network.neutron [req-eaca31aa-157a-4020-a6e6-1a7f1bf7e1bc req-30f9582a-c422-4473-8f53-57f2a3ea1dfb service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updating instance_info_cache with network_info: [{"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:02:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-eaca31aa-157a-4020-a6e6-1a7f1bf7e1bc req-30f9582a-c422-4473-8f53-57f2a3ea1dfb service nova] Releasing lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:02:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:50 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:52 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:52 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "c3b49cab-7be8-4186-8325-5a59995cdbfa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 21:02:53 user nova-compute[75239]: INFO nova.compute.claims [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Claim successful on node user
Nov 13 21:02:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 21:02:53 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 21:02:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 21:02:53 user nova-compute[75239]: DEBUG nova.policy [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e1458f29bb94b0abd4b75ac943fb531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc5530ef3c040dd82883043dabc4c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 21:02:53 user nova-compute[75239]: INFO nova.virt.block_device [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Booting with volume snapshot 315f1db1-2478-4485-995d-36d63c25c5bd at /dev/vda
Nov 13 21:02:54 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Successfully created port: b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Successfully updated port: b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "refresh_cache-c3b49cab-7be8-4186-8325-5a59995cdbfa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquired lock "refresh_cache-c3b49cab-7be8-4186-8325-5a59995cdbfa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-095cc5c9-df28-410f-85b1-665c1ae30c8b req-c4849cd9-0b86-47c6-96f5-7a787369991b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received event network-changed-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.compute.manager [req-095cc5c9-df28-410f-85b1-665c1ae30c8b req-c4849cd9-0b86-47c6-96f5-7a787369991b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Refreshing instance network info cache due to event network-changed-b798d4ab-5b4e-4df0-b466-d3060943c5f2. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-095cc5c9-df28-410f-85b1-665c1ae30c8b req-c4849cd9-0b86-47c6-96f5-7a787369991b service nova] Acquiring lock "refresh_cache-c3b49cab-7be8-4186-8325-5a59995cdbfa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.network.neutron [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Updating instance_info_cache with network_info: [{"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Releasing lock "refresh_cache-c3b49cab-7be8-4186-8325-5a59995cdbfa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Instance network_info: |[{"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-095cc5c9-df28-410f-85b1-665c1ae30c8b req-c4849cd9-0b86-47c6-96f5-7a787369991b service nova] Acquired lock "refresh_cache-c3b49cab-7be8-4186-8325-5a59995cdbfa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.network.neutron [req-095cc5c9-df28-410f-85b1-665c1ae30c8b req-c4849cd9-0b86-47c6-96f5-7a787369991b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Refreshing network info cache for port b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.network.neutron [req-095cc5c9-df28-410f-85b1-665c1ae30c8b req-c4849cd9-0b86-47c6-96f5-7a787369991b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Updated VIF entry in instance network info cache for port b798d4ab-5b4e-4df0-b466-d3060943c5f2. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG nova.network.neutron [req-095cc5c9-df28-410f-85b1-665c1ae30c8b req-c4849cd9-0b86-47c6-96f5-7a787369991b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Updating instance_info_cache with network_info: [{"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:02:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-095cc5c9-df28-410f-85b1-665c1ae30c8b req-c4849cd9-0b86-47c6-96f5-7a787369991b service nova] Releasing lock "refresh_cache-c3b49cab-7be8-4186-8325-5a59995cdbfa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:02:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Skipping network cache update for instance because it is Building. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid ffadc6ad-5f7c-481c-ba84-07a7676869aa {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updating instance_info_cache with network_info: [{"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:02:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG os_brick.utils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f1530b-0ad8-4515-b725-eb6cffc779d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f592483-5ce5-4356-81c5-7d367c852873]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba952fe-6203-4b40-8a3f-b067065af8be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3225d52-0346-40e5-8be9-f01e20b72565]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:02:59 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:02:59 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c7ea36-38d7-4f41-a975-8d11899563ca]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG os_brick.utils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:02:59 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Updating existing volume attachment record: 5364271d-fa4b-4930-a69d-3fd29562052d {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:03:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 21:03:04 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Creating image(s)
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Ensure instance console log exists: /opt/stack/data/nova/instances/c3b49cab-7be8-4186-8325-5a59995cdbfa/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Start _get_guest_xml network_info=[{"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T21:02:49Z,direct_url=<?>,disk_format='qcow2',id=4f635926-aafb-4c47-8693-72fdfc1e50ef,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1506559177',owner='fbc5530ef3c040dd82883043dabc4c7d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T21:02:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5364271d-fa4b-4930-a69d-3fd29562052d', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipFgNTml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c3b49cab-7be8-4186-8325-5a59995cdbfa', 'attached_at': '', 'detached_at': '', 'volume_id': '6c8f4adf-babe-4a0b-97f4-4c1ebe481763', 'serial': '6c8f4adf-babe-4a0b-97f4-4c1ebe481763'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 21:03:04 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:03:04 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T21:02:49Z,direct_url=<?>,disk_format='qcow2',id=4f635926-aafb-4c47-8693-72fdfc1e50ef,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1506559177',owner='fbc5530ef3c040dd82883043dabc4c7d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T21:02:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipFgNTml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:03:04 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:03:04 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:03:04 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d046740-8314-4a23-bb11-43c2d361148b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:03:04 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de5cc2-dea4-4a90-a277-09dc52ae35f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763] added
Nov 13 21:03:04 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cf22dd-da3f-4b03-853a-cbd732b0fecf]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[811cba22-2e35-4d8c-886c-5749cb81fdfb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipFgNTml {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ipFgNTml" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c0102d-8bcb-4abb-9818-c6148a16a93a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ipFgNTml'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[437ba749-98d4-4bc2-932e-77b5adf35ebd]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e952c5ab-cd2b-42ef-8635-12c8ff2ab419]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:03:04 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:03:04 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a339360a-03b1-4781-980f-bc00c273ebaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763, portal: 172.16.0.220,3260]
Nov 13 21:03:04 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763, portal: 172.16.0.220,3260] successful.
Nov 13 21:03:04 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3016e2d0-f137-4015-893d-3718ea9c4e40]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f359cb10-d4b7-4600-ae95-fbf9c1edc0bc]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:03:04 user nova-compute[75239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 (non-flash)
Nov 13 21:03:04 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:03:04 user nova-compute[75239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 (non-flash)
Nov 13 21:03:04 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76f18b0-0622-46d6-8dc3-b3e9fad359ef]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:03:04 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipFgNTml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26137343666323665', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137343666323665', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1465024556',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1465024556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1465024556',id=49,image_ref='4f635926-aafb-4c47-8693-72fdfc1e50ef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYr9+mtooCDZ02Gs3D/LgESU/lDn+muSxRGM2aZ76+6N+QXRzaC6LZh8nij7+8Mn8lLnGqYLjXoZS5X8JJmYMDk2CZO3TLl8twHzH3vDVqZyFU4YU7qx9ZB7PAwj3yp+A==',key_name='tempest-keypair-458023223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-gic65qiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1828724263',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=c3b49cab-7be8-4186-8325-5a59995cdbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=b798d4ab-5b4e-4df0-b466-d3060943c5f2,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb798d4ab-5b') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.objects.instance [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'pci_devices' on Instance uuid c3b49cab-7be8-4186-8325-5a59995cdbfa {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 21:03:05 user nova-compute[75239]:   <uuid>c3b49cab-7be8-4186-8325-5a59995cdbfa</uuid>
Nov 13 21:03:05 user nova-compute[75239]:   <name>instance-00000031</name>
Nov 13 21:03:05 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 21:03:05 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 21:03:05 user nova-compute[75239]:   <metadata>
Nov 13 21:03:05 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 21:03:05 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 21:03:05 user nova-compute[75239]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1465024556</nova:name>
Nov 13 21:03:05 user nova-compute[75239]:       <nova:creationTime>2023-11-13 21:03:04</nova:creationTime>
Nov 13 21:03:05 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 21:03:05 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 21:03:05 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 21:03:05 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 21:03:05 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 21:03:05 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 21:03:05 user nova-compute[75239]:       </nova:flavor>
Nov 13 21:03:05 user nova-compute[75239]:       <nova:owner>
Nov 13 21:03:05 user nova-compute[75239]:         <nova:user uuid="7e1458f29bb94b0abd4b75ac943fb531">tempest-TestVolumeBootPattern-1828724263-project-member</nova:user>
Nov 13 21:03:05 user nova-compute[75239]:         <nova:project uuid="fbc5530ef3c040dd82883043dabc4c7d">tempest-TestVolumeBootPattern-1828724263</nova:project>
Nov 13 21:03:05 user nova-compute[75239]:       </nova:owner>
Nov 13 21:03:05 user nova-compute[75239]:       <nova:root type="image" uuid="4f635926-aafb-4c47-8693-72fdfc1e50ef"/>
Nov 13 21:03:05 user nova-compute[75239]:       <nova:ports>
Nov 13 21:03:05 user nova-compute[75239]:         <nova:port uuid="b798d4ab-5b4e-4df0-b466-d3060943c5f2">
Nov 13 21:03:05 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 21:03:05 user nova-compute[75239]:         </nova:port>
Nov 13 21:03:05 user nova-compute[75239]:       </nova:ports>
Nov 13 21:03:05 user nova-compute[75239]:     </nova:instance>
Nov 13 21:03:05 user nova-compute[75239]:   </metadata>
Nov 13 21:03:05 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 21:03:05 user nova-compute[75239]:     <system>
Nov 13 21:03:05 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 21:03:05 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 21:03:05 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 21:03:05 user nova-compute[75239]:       <entry name="serial">c3b49cab-7be8-4186-8325-5a59995cdbfa</entry>
Nov 13 21:03:05 user nova-compute[75239]:       <entry name="uuid">c3b49cab-7be8-4186-8325-5a59995cdbfa</entry>
Nov 13 21:03:05 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 21:03:05 user nova-compute[75239]:     </system>
Nov 13 21:03:05 user nova-compute[75239]:   </sysinfo>
Nov 13 21:03:05 user nova-compute[75239]:   <os>
Nov 13 21:03:05 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 21:03:05 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 21:03:05 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 21:03:05 user nova-compute[75239]:   </os>
Nov 13 21:03:05 user nova-compute[75239]:   <features>
Nov 13 21:03:05 user nova-compute[75239]:     <acpi/>
Nov 13 21:03:05 user nova-compute[75239]:     <apic/>
Nov 13 21:03:05 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 21:03:05 user nova-compute[75239]:   </features>
Nov 13 21:03:05 user nova-compute[75239]:   <clock offset="utc">
Nov 13 21:03:05 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 21:03:05 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 21:03:05 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 21:03:05 user nova-compute[75239]:   </clock>
Nov 13 21:03:05 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 21:03:05 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 21:03:05 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 21:03:05 user nova-compute[75239]:   </cpu>
Nov 13 21:03:05 user nova-compute[75239]:   <devices>
Nov 13 21:03:05 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 21:03:05 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:03:05 user nova-compute[75239]:       <source dev="/dev/sdc"/>
Nov 13 21:03:05 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 21:03:05 user nova-compute[75239]:       <serial>6c8f4adf-babe-4a0b-97f4-4c1ebe481763</serial>
Nov 13 21:03:05 user nova-compute[75239]:     </disk>
Nov 13 21:03:05 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 21:03:05 user nova-compute[75239]:       <mac address="fa:16:3e:85:72:fc"/>
Nov 13 21:03:05 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:03:05 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 21:03:05 user nova-compute[75239]:       <target dev="tapb798d4ab-5b"/>
Nov 13 21:03:05 user nova-compute[75239]:     </interface>
Nov 13 21:03:05 user nova-compute[75239]:     <serial type="pty">
Nov 13 21:03:05 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/c3b49cab-7be8-4186-8325-5a59995cdbfa/console.log" append="off"/>
Nov 13 21:03:05 user nova-compute[75239]:     </serial>
Nov 13 21:03:05 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 21:03:05 user nova-compute[75239]:     <video>
Nov 13 21:03:05 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:03:05 user nova-compute[75239]:     </video>
Nov 13 21:03:05 user nova-compute[75239]:     <rng model="virtio">
Nov 13 21:03:05 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 21:03:05 user nova-compute[75239]:     </rng>
Nov 13 21:03:05 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 21:03:05 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 21:03:05 user nova-compute[75239]:       <stats period="10"/>
Nov 13 21:03:05 user nova-compute[75239]:     </memballoon>
Nov 13 21:03:05 user nova-compute[75239]:   </devices>
Nov 13 21:03:05 user nova-compute[75239]: </domain>
Nov 13 21:03:05 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1465024556',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1465024556',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1465024556',id=49,image_ref='4f635926-aafb-4c47-8693-72fdfc1e50ef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYr9+mtooCDZ02Gs3D/LgESU/lDn+muSxRGM2aZ76+6N+QXRzaC6LZh8nij7+8Mn8lLnGqYLjXoZS5X8JJmYMDk2CZO3TLl8twHzH3vDVqZyFU4YU7qx9ZB7PAwj3yp+A==',key_name='tempest-keypair-458023223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-gic65qiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1828724263',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=c3b49cab-7be8-4186-8325-5a59995cdbfa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=b798d4ab-5b4e-4df0-b466-d3060943c5f2,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb798d4ab-5b') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG os_vif [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=b798d4ab-5b4e-4df0-b466-d3060943c5f2,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb798d4ab-5b') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c507fd1a-c71f-5ae3-acbc-ba9448b09ce0', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb798d4ab-5b, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb798d4ab-5b, col_values=(('qos', UUID('75e59528-d165-4eb4-b6d8-ec91ee9f9671')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb798d4ab-5b, col_values=(('external_ids', {'iface-id': 'b798d4ab-5b4e-4df0-b466-d3060943c5f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:72:fc', 'vm-uuid': 'c3b49cab-7be8-4186-8325-5a59995cdbfa'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:05 user nova-compute[75239]: INFO os_vif [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=b798d4ab-5b4e-4df0-b466-d3060943c5f2,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb798d4ab-5b')
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:03:05 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No VIF found with MAC fa:16:3e:85:72:fc, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:03:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-fc64c8c2-4add-4ae1-abc7-6d363733da47 req-a1af31c6-a5ae-4b04-81d4-f41882a7de5f service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received event network-vif-plugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:03:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fc64c8c2-4add-4ae1-abc7-6d363733da47 req-a1af31c6-a5ae-4b04-81d4-f41882a7de5f service nova] Acquiring lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:03:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fc64c8c2-4add-4ae1-abc7-6d363733da47 req-a1af31c6-a5ae-4b04-81d4-f41882a7de5f service nova] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:03:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fc64c8c2-4add-4ae1-abc7-6d363733da47 req-a1af31c6-a5ae-4b04-81d4-f41882a7de5f service nova] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:03:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-fc64c8c2-4add-4ae1-abc7-6d363733da47 req-a1af31c6-a5ae-4b04-81d4-f41882a7de5f service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] No waiting events found dispatching network-vif-plugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:03:07 user nova-compute[75239]: WARNING nova.compute.manager [req-fc64c8c2-4add-4ae1-abc7-6d363733da47 req-a1af31c6-a5ae-4b04-81d4-f41882a7de5f service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received unexpected event network-vif-plugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 for instance with vm_state building and task_state spawning.
Nov 13 21:03:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 21:03:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 21:03:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Instance spawned successfully.
Nov 13 21:03:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 21:03:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:03:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:03:09 user nova-compute[75239]: INFO nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 13 21:03:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 21:03:09 user nova-compute[75239]: INFO nova.compute.manager [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Took 15.70 seconds to build instance.
Nov 13 21:03:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-d5552281-c592-4970-809f-bdeec1fcf5be tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.795s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:03:09 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-1dbd8be5-4634-4770-9c49-54a1f35d80d1 req-e1ec7787-f18c-4b15-9cbb-c617f5a7879f service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received event network-vif-plugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:03:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1dbd8be5-4634-4770-9c49-54a1f35d80d1 req-e1ec7787-f18c-4b15-9cbb-c617f5a7879f service nova] Acquiring lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:03:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1dbd8be5-4634-4770-9c49-54a1f35d80d1 req-e1ec7787-f18c-4b15-9cbb-c617f5a7879f service nova] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:03:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-1dbd8be5-4634-4770-9c49-54a1f35d80d1 req-e1ec7787-f18c-4b15-9cbb-c617f5a7879f service nova] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:03:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-1dbd8be5-4634-4770-9c49-54a1f35d80d1 req-e1ec7787-f18c-4b15-9cbb-c617f5a7879f service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] No waiting events found dispatching network-vif-plugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:03:09 user nova-compute[75239]: WARNING nova.compute.manager [req-1dbd8be5-4634-4770-9c49-54a1f35d80d1 req-e1ec7787-f18c-4b15-9cbb-c617f5a7879f service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received unexpected event network-vif-plugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 for instance with vm_state active and task_state None.
Nov 13 21:03:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:03:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:03:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:03:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:03:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:03:46 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:03:46 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:03:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=24.97414779663086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ffadc6ad-5f7c-481c-ba84-07a7676869aa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance c3b49cab-7be8-4186-8325-5a59995cdbfa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:03:46 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:03:47 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 21:03:47 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 21:03:47 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 21:03:47 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 21:03:47 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 21:03:47 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:03:47 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:03:47 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:03:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:03:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:03:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:54 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:03:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:03:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:03:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:03:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:03:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 21:03:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 21:03:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid ffadc6ad-5f7c-481c-ba84-07a7676869aa {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updating instance_info_cache with network_info: [{"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-ffadc6ad-5f7c-481c-ba84-07a7676869aa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:03:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:03:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:03:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 21:04:00 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:04:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:04:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:04:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:04:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:04:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:04:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:04:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:04:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:04:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:04:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:04:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:04:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-30469ea3-04e1-4474-8a55-ebe8dc5501db req-f5ce778e-9b92-4f08-bc10-af06f56e8e5b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received event network-changed-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:04:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-30469ea3-04e1-4474-8a55-ebe8dc5501db req-f5ce778e-9b92-4f08-bc10-af06f56e8e5b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Refreshing instance network info cache due to event network-changed-b798d4ab-5b4e-4df0-b466-d3060943c5f2. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:04:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30469ea3-04e1-4474-8a55-ebe8dc5501db req-f5ce778e-9b92-4f08-bc10-af06f56e8e5b service nova] Acquiring lock "refresh_cache-c3b49cab-7be8-4186-8325-5a59995cdbfa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:04:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30469ea3-04e1-4474-8a55-ebe8dc5501db req-f5ce778e-9b92-4f08-bc10-af06f56e8e5b service nova] Acquired lock "refresh_cache-c3b49cab-7be8-4186-8325-5a59995cdbfa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:04:44 user nova-compute[75239]: DEBUG nova.network.neutron [req-30469ea3-04e1-4474-8a55-ebe8dc5501db req-f5ce778e-9b92-4f08-bc10-af06f56e8e5b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Refreshing network info cache for port b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.network.neutron [req-30469ea3-04e1-4474-8a55-ebe8dc5501db req-f5ce778e-9b92-4f08-bc10-af06f56e8e5b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Updated VIF entry in instance network info cache for port b798d4ab-5b4e-4df0-b466-d3060943c5f2. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.network.neutron [req-30469ea3-04e1-4474-8a55-ebe8dc5501db req-f5ce778e-9b92-4f08-bc10-af06f56e8e5b service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Updating instance_info_cache with network_info: [{"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-30469ea3-04e1-4474-8a55-ebe8dc5501db req-f5ce778e-9b92-4f08-bc10-af06f56e8e5b service nova] Releasing lock "refresh_cache-c3b49cab-7be8-4186-8325-5a59995cdbfa" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "c3b49cab-7be8-4186-8325-5a59995cdbfa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:04:45 user nova-compute[75239]: INFO nova.compute.manager [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Terminating instance
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.compute.manager [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-5efeb007-a0a9-482f-8806-a07fcae03716 req-f0977cfe-0466-4f10-b3f7-58a88bf49a9e service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received event network-vif-unplugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5efeb007-a0a9-482f-8806-a07fcae03716 req-f0977cfe-0466-4f10-b3f7-58a88bf49a9e service nova] Acquiring lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5efeb007-a0a9-482f-8806-a07fcae03716 req-f0977cfe-0466-4f10-b3f7-58a88bf49a9e service nova] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5efeb007-a0a9-482f-8806-a07fcae03716 req-f0977cfe-0466-4f10-b3f7-58a88bf49a9e service nova] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-5efeb007-a0a9-482f-8806-a07fcae03716 req-f0977cfe-0466-4f10-b3f7-58a88bf49a9e service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] No waiting events found dispatching network-vif-unplugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.compute.manager [req-5efeb007-a0a9-482f-8806-a07fcae03716 req-f0977cfe-0466-4f10-b3f7-58a88bf49a9e service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received event network-vif-unplugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:45 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Instance destroyed successfully.
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.objects.instance [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'resources' on Instance uuid c3b49cab-7be8-4186-8325-5a59995cdbfa {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1465024556',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1465024556',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1465024556',id=49,image_ref='4f635926-aafb-4c47-8693-72fdfc1e50ef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPYr9+mtooCDZ02Gs3D/LgESU/lDn+muSxRGM2aZ76+6N+QXRzaC6LZh8nij7+8Mn8lLnGqYLjXoZS5X8JJmYMDk2CZO3TLl8twHzH3vDVqZyFU4YU7qx9ZB7PAwj3yp+A==',key_name='tempest-keypair-458023223',keypairs=<?>,launch_index=0,launched_at=2023-11-13T21:03:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-gic65qiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1828724263',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T21:03:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=c3b49cab-7be8-4186-8325-5a59995cdbfa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "address": "fa:16:3e:85:72:fc", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb798d4ab-5b", "ovs_interfaceid": "b798d4ab-5b4e-4df0-b466-d3060943c5f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=b798d4ab-5b4e-4df0-b466-d3060943c5f2,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb798d4ab-5b') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG os_vif [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=b798d4ab-5b4e-4df0-b466-d3060943c5f2,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb798d4ab-5b') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb798d4ab-5b, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75e59528-d165-4eb4-b6d8-ec91ee9f9671) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:45 user nova-compute[75239]: INFO os_vif [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:72:fc,bridge_name='br-int',has_traffic_filtering=True,id=b798d4ab-5b4e-4df0-b466-d3060943c5f2,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb798d4ab-5b')
Nov 13 21:04:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ipFgNTml', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:04:45 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:04:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:04:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b17819-0441-4010-bb45-91c41059a23c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:04:46 user nova-compute[75239]: No targets found.
Nov 13 21:04:46 user nova-compute[75239]: iSNS:
Nov 13 21:04:46 user nova-compute[75239]: No targets found.
Nov 13 21:04:46 user nova-compute[75239]: STATIC:
Nov 13 21:04:46 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2
Nov 13 21:04:46 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:04:46 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:04:46 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763
Nov 13 21:04:46 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:04:46 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:04:46 user nova-compute[75239]: FIRMWARE:
Nov 13 21:04:46 user nova-compute[75239]: No targets found.
Nov 13 21:04:46 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:04:46 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:04:46 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9841991d-f1ed-4e99-adab-1d94d3fb7d9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e651d-f865-43c7-b481-7f6dd6758529]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:04:46 user nova-compute[75239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 (non-flash)
Nov 13 21:04:46 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:04:46 user nova-compute[75239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 (non-flash)
Nov 13 21:04:46 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d604151b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc38360-a722-4f98-b9cf-1a05b9aa8ed1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d4474b-792f-46e0-a973-b1212356fe5e]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5201e1-1f9d-4458-a8c2-5cde05be13f0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2fa1c9-e3a2-46d0-b60d-e5b093a09a18]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_84ff39a8', '/dev/disk/by-id/scsi-26137343666323665', '/dev/disk/by-id/scsi-1SCST_BIO84ff39a8-a746f26e026674f6') {{(pid=86402) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4640149-f4cc-48cd-962f-e9a69f95e44a]: (4, None) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98c7b85-6f64-48f6-bee7-25e77d018259]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e52fe0c-58e6-44eb-bb65-3b0d6a0f8904]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763, portal: 172.16.0.220,3260]
Nov 13 21:04:46 user nova-compute[75239]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763, portal: 172.16.0.220,3260] successful.
Nov 13 21:04:46 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c8f4adf-babe-4a0b-97f4-4c1ebe481763 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f1d1a1-3331-4885-b6f4-d44a63440bd8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== disconnect_volume: return (310ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:04:46 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Deleting instance files /opt/stack/data/nova/instances/c3b49cab-7be8-4186-8325-5a59995cdbfa_del
Nov 13 21:04:46 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Deletion of /opt/stack/data/nova/instances/c3b49cab-7be8-4186-8325-5a59995cdbfa_del complete
Nov 13 21:04:46 user nova-compute[75239]: INFO nova.compute.manager [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 13 21:04:46 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:04:46 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:04:47 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:04:47 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Took 0.85 seconds to deallocate network for instance.
Nov 13 21:04:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-f67671af-bf19-4f4f-9390-e95e0e14e070 req-58cb3291-8fda-463b-83ca-126517a8d8ee service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received event network-vif-deleted-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:04:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-664067dc-3691-4918-861c-2495f225bf3a req-60b71624-a1e5-46a2-a1e6-d0e503677177 service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received event network-vif-plugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:04:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-664067dc-3691-4918-861c-2495f225bf3a req-60b71624-a1e5-46a2-a1e6-d0e503677177 service nova] Acquiring lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:04:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-664067dc-3691-4918-861c-2495f225bf3a req-60b71624-a1e5-46a2-a1e6-d0e503677177 service nova] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:04:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-664067dc-3691-4918-861c-2495f225bf3a req-60b71624-a1e5-46a2-a1e6-d0e503677177 service nova] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:04:47 user nova-compute[75239]: DEBUG nova.compute.manager [req-664067dc-3691-4918-861c-2495f225bf3a req-60b71624-a1e5-46a2-a1e6-d0e503677177 service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] No waiting events found dispatching network-vif-plugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:04:47 user nova-compute[75239]: WARNING nova.compute.manager [req-664067dc-3691-4918-861c-2495f225bf3a req-60b71624-a1e5-46a2-a1e6-d0e503677177 service nova] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Received unexpected event network-vif-plugged-b798d4ab-5b4e-4df0-b466-d3060943c5f2 for instance with vm_state active and task_state deleting.
Nov 13 21:04:47 user nova-compute[75239]: INFO nova.compute.manager [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Took 0.71 seconds to detach 1 volumes for instance.
Nov 13 21:04:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: c3b49cab-7be8-4186-8325-5a59995cdbfa] Deleting volume: 6c8f4adf-babe-4a0b-97f4-4c1ebe481763 {{(pid=75239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.012s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:04:48 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Deleted allocations for instance c3b49cab-7be8-4186-8325-5a59995cdbfa
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-11912428-9a6b-4352-95ba-9678700c59b9 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "c3b49cab-7be8-4186-8325-5a59995cdbfa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.561s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:04:48 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:04:48 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=24.971298217773438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance ffadc6ad-5f7c-481c-ba84-07a7676869aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:04:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:04:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:04:52 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:04:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:04:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:04:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 21:05:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:05:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:13 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:05:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:05:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:05:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:05:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:05:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:05:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:05:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:05:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:05:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:05:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:05:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:05:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:05:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:05:36 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:05:36 user nova-compute[75239]: INFO nova.compute.manager [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Terminating instance
Nov 13 21:05:36 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 21:05:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-0266d117-29d8-411b-905f-6be3bbe260a0 req-e514db81-9ac7-45aa-96db-6b0b9d5c17c2 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received event network-vif-unplugged-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0266d117-29d8-411b-905f-6be3bbe260a0 req-e514db81-9ac7-45aa-96db-6b0b9d5c17c2 service nova] Acquiring lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0266d117-29d8-411b-905f-6be3bbe260a0 req-e514db81-9ac7-45aa-96db-6b0b9d5c17c2 service nova] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-0266d117-29d8-411b-905f-6be3bbe260a0 req-e514db81-9ac7-45aa-96db-6b0b9d5c17c2 service nova] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-0266d117-29d8-411b-905f-6be3bbe260a0 req-e514db81-9ac7-45aa-96db-6b0b9d5c17c2 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] No waiting events found dispatching network-vif-unplugged-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG nova.compute.manager [req-0266d117-29d8-411b-905f-6be3bbe260a0 req-e514db81-9ac7-45aa-96db-6b0b9d5c17c2 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received event network-vif-unplugged-38264b39-d279-4a9d-92a4-f3e50f002a94 for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:05:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Instance destroyed successfully.
Nov 13 21:05:37 user nova-compute[75239]: DEBUG nova.objects.instance [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'resources' on Instance uuid ffadc6ad-5f7c-481c-ba84-07a7676869aa {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:00:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-91555584',display_name='tempest-TestVolumeBootPattern-volume-backed-server-91555584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-91555584',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8JpeFahu5SJVQ89A1xpuY8IGus/gZkaGElU0UCsLCEFOe1Q9rtsyk3SFdJQuwhFZrpTHx0fKVfqkaslVR+f3Ct/uSQ8rI/a4AbeT+ffCvtHo2zqOiIKDwBTsX5TiAWNw==',key_name='tempest-keypair-2131526261',keypairs=<?>,launch_index=0,launched_at=2023-11-13T21:01:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-23iz07d9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T21:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=ffadc6ad-5f7c-481c-ba84-07a7676869aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "38264b39-d279-4a9d-92a4-f3e50f002a94", "address": "fa:16:3e:23:97:e2", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38264b39-d2", "ovs_interfaceid": "38264b39-d279-4a9d-92a4-f3e50f002a94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:97:e2,bridge_name='br-int',has_traffic_filtering=True,id=38264b39-d279-4a9d-92a4-f3e50f002a94,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38264b39-d2') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_vif [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:97:e2,bridge_name='br-int',has_traffic_filtering=True,id=38264b39-d279-4a9d-92a4-f3e50f002a94,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38264b39-d2') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38264b39-d2, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83f11ddf-4cf4-452b-acdc-ba04a5f047ee) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:37 user nova-compute[75239]: INFO os_vif [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:97:e2,bridge_name='br-int',has_traffic_filtering=True,id=38264b39-d279-4a9d-92a4-f3e50f002a94,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38264b39-d2')
Nov 13 21:05:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dAMxQupf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:05:37 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1d7575-3218-4239-ba8c-0e9cb453758a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:05:37 user nova-compute[75239]: No targets found.
Nov 13 21:05:37 user nova-compute[75239]: iSNS:
Nov 13 21:05:37 user nova-compute[75239]: No targets found.
Nov 13 21:05:37 user nova-compute[75239]: STATIC:
Nov 13 21:05:37 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2
Nov 13 21:05:37 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:05:37 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:05:37 user nova-compute[75239]: FIRMWARE:
Nov 13 21:05:37 user nova-compute[75239]: No targets found.
Nov 13 21:05:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:05:37 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:05:37 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[755b1e5f-5c15-40c2-9914-e71c4fdbb8ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab576fd-498a-4dcb-9123-f348eb1162ba]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:05:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 (non-flash)
Nov 13 21:05:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60415fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d458b8-aefb-4932-9948-0884586cf5b4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3d3ce9-b92e-4d07-b621-a93fe7263e32]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d954236-e445-498c-8004-6fc0fb34d5ed]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[474be4c8-5029-4f99-afd8-c7e7b2acfd0e]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd2c14871-014f0a7f93410f26', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d2c14871', '/dev/disk/by-id/scsi-23031346630613766') {{(pid=86402) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41eb8a5-14b1-49c5-a782-f4ea042c1d89]: (4, None) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[463a1b87-0016-4eac-ad78-2cbea18dfb7e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b58566a-6963-4f68-a4ae-7420283ca280]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2, portal: 172.16.0.220,3260]
Nov 13 21:05:37 user nova-compute[75239]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2, portal: 172.16.0.220,3260] successful.
Nov 13 21:05:37 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac430472-dd70-4a78-b145-8c4d5fb80bb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[381fd9c0-5651-4b9c-8407-411cdd351fa9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== disconnect_volume: return (292ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:05:37 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:05:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Deleting instance files /opt/stack/data/nova/instances/ffadc6ad-5f7c-481c-ba84-07a7676869aa_del
Nov 13 21:05:37 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Deletion of /opt/stack/data/nova/instances/ffadc6ad-5f7c-481c-ba84-07a7676869aa_del complete
Nov 13 21:05:38 user nova-compute[75239]: INFO nova.compute.manager [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 13 21:05:38 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:05:38 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:05:38 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:05:38 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:05:38 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Took 0.63 seconds to deallocate network for instance.
Nov 13 21:05:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-732515eb-aa46-4526-bd44-9ffc54217c87 req-edb276b9-cf7d-4101-9ab5-33178b36ba29 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received event network-vif-deleted-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:05:38 user nova-compute[75239]: INFO nova.compute.manager [req-732515eb-aa46-4526-bd44-9ffc54217c87 req-edb276b9-cf7d-4101-9ab5-33178b36ba29 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Neutron deleted interface 38264b39-d279-4a9d-92a4-f3e50f002a94; detaching it from the instance and deleting it from the info cache
Nov 13 21:05:38 user nova-compute[75239]: DEBUG nova.network.neutron [req-732515eb-aa46-4526-bd44-9ffc54217c87 req-edb276b9-cf7d-4101-9ab5-33178b36ba29 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:05:38 user nova-compute[75239]: DEBUG nova.compute.manager [req-732515eb-aa46-4526-bd44-9ffc54217c87 req-edb276b9-cf7d-4101-9ab5-33178b36ba29 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Detach interface failed, port_id=38264b39-d279-4a9d-92a4-f3e50f002a94, reason: Instance ffadc6ad-5f7c-481c-ba84-07a7676869aa could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 21:05:39 user nova-compute[75239]: INFO nova.compute.manager [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Took 0.68 seconds to detach 1 volumes for instance.
Nov 13 21:05:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Deleting volume: ac430472-dd70-4a78-b145-8c4d5fb80bb2 {{(pid=75239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 21:05:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-c08dad57-4ca5-4840-934f-5ffc39a9d2ba req-2bb21129-925e-4169-9667-b219a76e5d46 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received event network-vif-plugged-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:05:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c08dad57-4ca5-4840-934f-5ffc39a9d2ba req-2bb21129-925e-4169-9667-b219a76e5d46 service nova] Acquiring lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:05:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c08dad57-4ca5-4840-934f-5ffc39a9d2ba req-2bb21129-925e-4169-9667-b219a76e5d46 service nova] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:05:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c08dad57-4ca5-4840-934f-5ffc39a9d2ba req-2bb21129-925e-4169-9667-b219a76e5d46 service nova] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:05:39 user nova-compute[75239]: DEBUG nova.compute.manager [req-c08dad57-4ca5-4840-934f-5ffc39a9d2ba req-2bb21129-925e-4169-9667-b219a76e5d46 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] No waiting events found dispatching network-vif-plugged-38264b39-d279-4a9d-92a4-f3e50f002a94 {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:05:39 user nova-compute[75239]: WARNING nova.compute.manager [req-c08dad57-4ca5-4840-934f-5ffc39a9d2ba req-2bb21129-925e-4169-9667-b219a76e5d46 service nova] [instance: ffadc6ad-5f7c-481c-ba84-07a7676869aa] Received unexpected event network-vif-plugged-38264b39-d279-4a9d-92a4-f3e50f002a94 for instance with vm_state active and task_state deleting.
Nov 13 21:05:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:05:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:05:39 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:05:39 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:05:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:05:39 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Deleted allocations for instance ffadc6ad-5f7c-481c-ba84-07a7676869aa
Nov 13 21:05:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-ff415381-107e-4291-ad1a-fa6d8147beac tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "ffadc6ad-5f7c-481c-ba84-07a7676869aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.852s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:05:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:05:47 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:05:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:05:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:05:49 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:05:49 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:05:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9180MB free_disk=24.970481872558594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:05:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.254s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:05:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:05:54 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:05:54 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:05:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:05:58 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:05:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:06:00 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:06:00 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:06:00 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:06:00 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 21:06:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:06:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:06:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:06:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:03 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:06:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:06:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:06:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:06:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 21:06:33 user nova-compute[75239]: INFO nova.compute.claims [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Claim successful on node user
Nov 13 21:06:33 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 21:06:33 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 21:06:34 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 21:06:34 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG nova.policy [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e1458f29bb94b0abd4b75ac943fb531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc5530ef3c040dd82883043dabc4c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 21:06:34 user nova-compute[75239]: INFO nova.virt.block_device [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Booting with volume f222e2fb-0c96-481d-a54a-0f3a10f32675 at /dev/vda
Nov 13 21:06:34 user nova-compute[75239]: DEBUG os_brick.utils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[358f00f2-413c-4f77-ab37-2c6ece7bb287]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20338df-d6ae-4074-b130-214518592ca4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92932cd0-0c8f-4813-80f7-45f0ec87b17e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdfb8ff-3fdf-465b-9183-12ff2bae1d17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:06:34 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:06:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b8496a-6c7d-48b1-ad11-0eb03e0c199e]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG os_brick.utils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updating existing volume attachment record: c875c342-042b-47a9-babf-417d3f830ec6 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:06:34 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Successfully created port: 7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Successfully updated port: 7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquired lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-d5dd4fed-d792-45bf-bb91-835d2ad45f78 req-159f6cd9-5dd8-4e7c-aeaf-4b94e34cae90 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-changed-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.compute.manager [req-d5dd4fed-d792-45bf-bb91-835d2ad45f78 req-159f6cd9-5dd8-4e7c-aeaf-4b94e34cae90 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Refreshing instance network info cache due to event network-changed-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d5dd4fed-d792-45bf-bb91-835d2ad45f78 req-159f6cd9-5dd8-4e7c-aeaf-4b94e34cae90 service nova] Acquiring lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.network.neutron [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updating instance_info_cache with network_info: [{"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Releasing lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Instance network_info: |[{"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d5dd4fed-d792-45bf-bb91-835d2ad45f78 req-159f6cd9-5dd8-4e7c-aeaf-4b94e34cae90 service nova] Acquired lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.network.neutron [req-d5dd4fed-d792-45bf-bb91-835d2ad45f78 req-159f6cd9-5dd8-4e7c-aeaf-4b94e34cae90 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Refreshing network info cache for port 7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.network.neutron [req-d5dd4fed-d792-45bf-bb91-835d2ad45f78 req-159f6cd9-5dd8-4e7c-aeaf-4b94e34cae90 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updated VIF entry in instance network info cache for port 7c7169e4-c5dd-4c42-b9ee-4d4a8789829b. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG nova.network.neutron [req-d5dd4fed-d792-45bf-bb91-835d2ad45f78 req-159f6cd9-5dd8-4e7c-aeaf-4b94e34cae90 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updating instance_info_cache with network_info: [{"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:06:35 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d5dd4fed-d792-45bf-bb91-835d2ad45f78 req-159f6cd9-5dd8-4e7c-aeaf-4b94e34cae90 service nova] Releasing lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:06:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 21:06:38 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Creating image(s)
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Ensure instance console log exists: /opt/stack/data/nova/instances/e1774bee-0adc-4b27-baf2-7928c7e31343/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Start _get_guest_xml network_info=[{"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c875c342-042b-47a9-babf-417d3f830ec6', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpHCQvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1774bee-0adc-4b27-baf2-7928c7e31343', 'attached_at': '', 'detached_at': '', 'volume_id': 'f222e2fb-0c96-481d-a54a-0f3a10f32675', 'serial': 'f222e2fb-0c96-481d-a54a-0f3a10f32675'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 21:06:38 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:06:38 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpHCQvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:06:38 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:06:38 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:06:38 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a15f60-4c88-4523-ab5d-9dd44b275588]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:06:38 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[914177d3-c8df-462e-afc1-3b57c446af3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675] added
Nov 13 21:06:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e347d3b-2a44-4272-812c-176b299b5403]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d206648-ea7f-4b0e-b367-1b6b6226cc21]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpHCQvNT {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpHCQvNT" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5e7a37-b9fa-4073-b41d-7e66d98c7f6d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tpHCQvNT'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c857a53-5154-432e-83bd-2b46db07bf41]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f557c6-920e-4491-be23-00ced1869559]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:06:38 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:06:38 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:06:38 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 21:06:38 user nova-compute[75239]: 
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40110d5-1b98-4d05-82eb-41b4074e8734]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260]
Nov 13 21:06:38 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260] successful.
Nov 13 21:06:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddc92dc-0986-4261-a4dc-1179d1828be8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aa069f-4b8a-4ff9-8984-da4d2109617f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:06:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:06:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c014e79d-1e1d-4f03-baac-1768e56eda48]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:06:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpHCQvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23765666234666530', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765666234666530', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-19801299',display_name='tempest-TestVolumeBootPattern-server-19801299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-19801299',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInC+sZCaKDSI50O8C8gGNwh8J8RgdnkdYIEwC/z0KDx2uN6GFrm5Akq9jizFgdrHKLHCMpaEbLx/BZo3JjgjKWbrE7hgTFDncZBWFRtdULHtjLI6ELBo5Oz3EJMja6xow==',key_name='tempest-TestVolumeBootPattern-1106875438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-5warl9rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:06:34Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=e1774bee-0adc-4b27-baf2-7928c7e31343,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b3:1b,bridge_name='br-int',has_traffic_filtering=True,id=7c7169e4-c5dd-4c42-b9ee-4d4a8789829b,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7169e4-c5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'pci_devices' on Instance uuid e1774bee-0adc-4b27-baf2-7928c7e31343 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] End _get_guest_xml xml=<domain type="kvm">
Nov 13 21:06:39 user nova-compute[75239]:   <uuid>e1774bee-0adc-4b27-baf2-7928c7e31343</uuid>
Nov 13 21:06:39 user nova-compute[75239]:   <name>instance-00000032</name>
Nov 13 21:06:39 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 21:06:39 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 21:06:39 user nova-compute[75239]:   <metadata>
Nov 13 21:06:39 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 21:06:39 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 21:06:39 user nova-compute[75239]:       <nova:name>tempest-TestVolumeBootPattern-server-19801299</nova:name>
Nov 13 21:06:39 user nova-compute[75239]:       <nova:creationTime>2023-11-13 21:06:38</nova:creationTime>
Nov 13 21:06:39 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 21:06:39 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 21:06:39 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 21:06:39 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 21:06:39 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 21:06:39 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 21:06:39 user nova-compute[75239]:       </nova:flavor>
Nov 13 21:06:39 user nova-compute[75239]:       <nova:owner>
Nov 13 21:06:39 user nova-compute[75239]:         <nova:user uuid="7e1458f29bb94b0abd4b75ac943fb531">tempest-TestVolumeBootPattern-1828724263-project-member</nova:user>
Nov 13 21:06:39 user nova-compute[75239]:         <nova:project uuid="fbc5530ef3c040dd82883043dabc4c7d">tempest-TestVolumeBootPattern-1828724263</nova:project>
Nov 13 21:06:39 user nova-compute[75239]:       </nova:owner>
Nov 13 21:06:39 user nova-compute[75239]:       <nova:ports>
Nov 13 21:06:39 user nova-compute[75239]:         <nova:port uuid="7c7169e4-c5dd-4c42-b9ee-4d4a8789829b">
Nov 13 21:06:39 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 21:06:39 user nova-compute[75239]:         </nova:port>
Nov 13 21:06:39 user nova-compute[75239]:       </nova:ports>
Nov 13 21:06:39 user nova-compute[75239]:     </nova:instance>
Nov 13 21:06:39 user nova-compute[75239]:   </metadata>
Nov 13 21:06:39 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 21:06:39 user nova-compute[75239]:     <system>
Nov 13 21:06:39 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 21:06:39 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 21:06:39 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 21:06:39 user nova-compute[75239]:       <entry name="serial">e1774bee-0adc-4b27-baf2-7928c7e31343</entry>
Nov 13 21:06:39 user nova-compute[75239]:       <entry name="uuid">e1774bee-0adc-4b27-baf2-7928c7e31343</entry>
Nov 13 21:06:39 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 21:06:39 user nova-compute[75239]:     </system>
Nov 13 21:06:39 user nova-compute[75239]:   </sysinfo>
Nov 13 21:06:39 user nova-compute[75239]:   <os>
Nov 13 21:06:39 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 21:06:39 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 21:06:39 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 21:06:39 user nova-compute[75239]:   </os>
Nov 13 21:06:39 user nova-compute[75239]:   <features>
Nov 13 21:06:39 user nova-compute[75239]:     <acpi/>
Nov 13 21:06:39 user nova-compute[75239]:     <apic/>
Nov 13 21:06:39 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 21:06:39 user nova-compute[75239]:   </features>
Nov 13 21:06:39 user nova-compute[75239]:   <clock offset="utc">
Nov 13 21:06:39 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 21:06:39 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 21:06:39 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 21:06:39 user nova-compute[75239]:   </clock>
Nov 13 21:06:39 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 21:06:39 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 21:06:39 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 21:06:39 user nova-compute[75239]:   </cpu>
Nov 13 21:06:39 user nova-compute[75239]:   <devices>
Nov 13 21:06:39 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 21:06:39 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:06:39 user nova-compute[75239]:       <source dev="/dev/sdb"/>
Nov 13 21:06:39 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 21:06:39 user nova-compute[75239]:       <serial>f222e2fb-0c96-481d-a54a-0f3a10f32675</serial>
Nov 13 21:06:39 user nova-compute[75239]:     </disk>
Nov 13 21:06:39 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 21:06:39 user nova-compute[75239]:       <mac address="fa:16:3e:a3:b3:1b"/>
Nov 13 21:06:39 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:06:39 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 21:06:39 user nova-compute[75239]:       <target dev="tap7c7169e4-c5"/>
Nov 13 21:06:39 user nova-compute[75239]:     </interface>
Nov 13 21:06:39 user nova-compute[75239]:     <serial type="pty">
Nov 13 21:06:39 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/e1774bee-0adc-4b27-baf2-7928c7e31343/console.log" append="off"/>
Nov 13 21:06:39 user nova-compute[75239]:     </serial>
Nov 13 21:06:39 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 21:06:39 user nova-compute[75239]:     <video>
Nov 13 21:06:39 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:06:39 user nova-compute[75239]:     </video>
Nov 13 21:06:39 user nova-compute[75239]:     <rng model="virtio">
Nov 13 21:06:39 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 21:06:39 user nova-compute[75239]:     </rng>
Nov 13 21:06:39 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 21:06:39 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 21:06:39 user nova-compute[75239]:       <stats period="10"/>
Nov 13 21:06:39 user nova-compute[75239]:     </memballoon>
Nov 13 21:06:39 user nova-compute[75239]:   </devices>
Nov 13 21:06:39 user nova-compute[75239]: </domain>
Nov 13 21:06:39 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-19801299',display_name='tempest-TestVolumeBootPattern-server-19801299',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-19801299',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInC+sZCaKDSI50O8C8gGNwh8J8RgdnkdYIEwC/z0KDx2uN6GFrm5Akq9jizFgdrHKLHCMpaEbLx/BZo3JjgjKWbrE7hgTFDncZBWFRtdULHtjLI6ELBo5Oz3EJMja6xow==',key_name='tempest-TestVolumeBootPattern-1106875438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-5warl9rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:06:34Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=e1774bee-0adc-4b27-baf2-7928c7e31343,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b3:1b,bridge_name='br-int',has_traffic_filtering=True,id=7c7169e4-c5dd-4c42-b9ee-4d4a8789829b,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7169e4-c5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG os_vif [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b3:1b,bridge_name='br-int',has_traffic_filtering=True,id=7c7169e4-c5dd-4c42-b9ee-4d4a8789829b,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7169e4-c5') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b4aff21-d19a-5982-878c-5d71916e2d77', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c7169e4-c5, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c7169e4-c5, col_values=(('qos', UUID('bb4f70d5-fca3-42cb-afdf-cc96fb12cd7d')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c7169e4-c5, col_values=(('external_ids', {'iface-id': '7c7169e4-c5dd-4c42-b9ee-4d4a8789829b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:b3:1b', 'vm-uuid': 'e1774bee-0adc-4b27-baf2-7928c7e31343'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:39 user nova-compute[75239]: INFO os_vif [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:b3:1b,bridge_name='br-int',has_traffic_filtering=True,id=7c7169e4-c5dd-4c42-b9ee-4d4a8789829b,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7169e4-c5')
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:06:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No VIF found with MAC fa:16:3e:a3:b3:1b, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-c1ca9ed8-8ebb-4857-baee-c341c0834922 req-6af68b99-1ce9-4c7f-9e41-54556b27ec73 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c1ca9ed8-8ebb-4857-baee-c341c0834922 req-6af68b99-1ce9-4c7f-9e41-54556b27ec73 service nova] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c1ca9ed8-8ebb-4857-baee-c341c0834922 req-6af68b99-1ce9-4c7f-9e41-54556b27ec73 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c1ca9ed8-8ebb-4857-baee-c341c0834922 req-6af68b99-1ce9-4c7f-9e41-54556b27ec73 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-c1ca9ed8-8ebb-4857-baee-c341c0834922 req-6af68b99-1ce9-4c7f-9e41-54556b27ec73 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] No waiting events found dispatching network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:06:41 user nova-compute[75239]: WARNING nova.compute.manager [req-c1ca9ed8-8ebb-4857-baee-c341c0834922 req-6af68b99-1ce9-4c7f-9e41-54556b27ec73 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received unexpected event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b for instance with vm_state building and task_state spawning.
Nov 13 21:06:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 21:06:43 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Instance spawned successfully.
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-11684925-07ec-4fa3-b619-4ee5a0ff87b4 req-c3288287-77ba-40f8-9370-96699fffed1f service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-11684925-07ec-4fa3-b619-4ee5a0ff87b4 req-c3288287-77ba-40f8-9370-96699fffed1f service nova] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-11684925-07ec-4fa3-b619-4ee5a0ff87b4 req-c3288287-77ba-40f8-9370-96699fffed1f service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-11684925-07ec-4fa3-b619-4ee5a0ff87b4 req-c3288287-77ba-40f8-9370-96699fffed1f service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.compute.manager [req-11684925-07ec-4fa3-b619-4ee5a0ff87b4 req-c3288287-77ba-40f8-9370-96699fffed1f service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] No waiting events found dispatching network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:06:43 user nova-compute[75239]: WARNING nova.compute.manager [req-11684925-07ec-4fa3-b619-4ee5a0ff87b4 req-c3288287-77ba-40f8-9370-96699fffed1f service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received unexpected event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b for instance with vm_state building and task_state spawning.
Nov 13 21:06:43 user nova-compute[75239]: INFO nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 13 21:06:43 user nova-compute[75239]: DEBUG nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 21:06:43 user nova-compute[75239]: INFO nova.compute.manager [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Took 9.89 seconds to build instance.
Nov 13 21:06:43 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9f31e85b-0a81-49a9-a6f3-2cbc7666ff3d tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.989s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:06:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:06:49 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:06:49 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9092MB free_disk=24.960643768310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e1774bee-0adc-4b27-baf2-7928c7e31343 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:06:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:06:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:06:54 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:06:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:06:55 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:06:58 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:06:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:06:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid e1774bee-0adc-4b27-baf2-7928c7e31343 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updating instance_info_cache with network_info: [{"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:07:02 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:07:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:15 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:07:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:07:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:07:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:07:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:07:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:07:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:07:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:07:51 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:07:51 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9043MB free_disk=24.959972381591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance e1774bee-0adc-4b27-baf2-7928c7e31343 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:07:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:07:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:07:55 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:58 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:07:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid e1774bee-0adc-4b27-baf2-7928c7e31343 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updating instance_info_cache with network_info: [{"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:08:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:08:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:08:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Verify base images {{(pid=75239) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75239) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] e1774bee-0adc-4b27-baf2-7928c7e31343 is a valid instance name {{(pid=75239) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315
Nov 13 21:08:21 user nova-compute[75239]: WARNING nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Removable base files: /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95 /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8 /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5 /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44 /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315 /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3c66175cdf6c624f95069611163a4acc7e34ac95
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1262e370fd64eaf3df14ee84eb577c607d631afa
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/50e87d38af29550d7ca96cdfce4778ab1dd8c4a8
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/90a9c5fb88a0a89821995148a9edede74347090a
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b5b056ba05aca26f288cc4b254eb610dad6bd84c
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1c93777757883336c103b47f33e6c2696f9e6cc5
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/442ba8ebb6f4369fdb27d36f3ee5a63009c35f44
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/32aa0b2340b9686276b64571bc2572d4e877c315
Nov 13 21:08:21 user nova-compute[75239]: INFO nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b17f70e6f080e8f87244d5ac9f2f933885bfb5f8
Nov 13 21:08:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Verification complete {{(pid=75239) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Verify swap images {{(pid=75239) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 13 21:08:21 user nova-compute[75239]: DEBUG nova.virt.libvirt.imagecache [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Verify ephemeral images {{(pid=75239) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 13 21:08:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-34ec8048-5c56-4987-898a-5dd1b932854b req-6ce2f613-4dca-49aa-9ee2-81a92919283d service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-changed-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-34ec8048-5c56-4987-898a-5dd1b932854b req-6ce2f613-4dca-49aa-9ee2-81a92919283d service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Refreshing instance network info cache due to event network-changed-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-34ec8048-5c56-4987-898a-5dd1b932854b req-6ce2f613-4dca-49aa-9ee2-81a92919283d service nova] Acquiring lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-34ec8048-5c56-4987-898a-5dd1b932854b req-6ce2f613-4dca-49aa-9ee2-81a92919283d service nova] Acquired lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG nova.network.neutron [req-34ec8048-5c56-4987-898a-5dd1b932854b req-6ce2f613-4dca-49aa-9ee2-81a92919283d service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Refreshing network info cache for port 7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG nova.network.neutron [req-34ec8048-5c56-4987-898a-5dd1b932854b req-6ce2f613-4dca-49aa-9ee2-81a92919283d service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updated VIF entry in instance network info cache for port 7c7169e4-c5dd-4c42-b9ee-4d4a8789829b. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG nova.network.neutron [req-34ec8048-5c56-4987-898a-5dd1b932854b req-6ce2f613-4dca-49aa-9ee2-81a92919283d service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updating instance_info_cache with network_info: [{"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-34ec8048-5c56-4987-898a-5dd1b932854b req-6ce2f613-4dca-49aa-9ee2-81a92919283d service nova] Releasing lock "refresh_cache-e1774bee-0adc-4b27-baf2-7928c7e31343" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:25 user nova-compute[75239]: INFO nova.compute.manager [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Terminating instance
Nov 13 21:08:25 user nova-compute[75239]: DEBUG nova.compute.manager [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Instance destroyed successfully.
Nov 13 21:08:26 user nova-compute[75239]: DEBUG nova.objects.instance [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'resources' on Instance uuid e1774bee-0adc-4b27-baf2-7928c7e31343 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:06:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-19801299',display_name='tempest-TestVolumeBootPattern-server-19801299',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-19801299',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInC+sZCaKDSI50O8C8gGNwh8J8RgdnkdYIEwC/z0KDx2uN6GFrm5Akq9jizFgdrHKLHCMpaEbLx/BZo3JjgjKWbrE7hgTFDncZBWFRtdULHtjLI6ELBo5Oz3EJMja6xow==',key_name='tempest-TestVolumeBootPattern-1106875438',keypairs=<?>,launch_index=0,launched_at=2023-11-13T21:06:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-5warl9rr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T21:06:44Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=e1774bee-0adc-4b27-baf2-7928c7e31343,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "address": "fa:16:3e:a3:b3:1b", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7169e4-c5", "ovs_interfaceid": "7c7169e4-c5dd-4c42-b9ee-4d4a8789829b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b3:1b,bridge_name='br-int',has_traffic_filtering=True,id=7c7169e4-c5dd-4c42-b9ee-4d4a8789829b,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7169e4-c5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_vif [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b3:1b,bridge_name='br-int',has_traffic_filtering=True,id=7c7169e4-c5dd-4c42-b9ee-4d4a8789829b,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7169e4-c5') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c7169e4-c5, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb4f70d5-fca3-42cb-afdf-cc96fb12cd7d) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:26 user nova-compute[75239]: INFO os_vif [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:b3:1b,bridge_name='br-int',has_traffic_filtering=True,id=7c7169e4-c5dd-4c42-b9ee-4d4a8789829b,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7169e4-c5')
Nov 13 21:08:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpHCQvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:08:26 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3b086d-37ca-4b5d-80e1-febb644be5b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:08:26 user nova-compute[75239]: No targets found.
Nov 13 21:08:26 user nova-compute[75239]: iSNS:
Nov 13 21:08:26 user nova-compute[75239]: No targets found.
Nov 13 21:08:26 user nova-compute[75239]: STATIC:
Nov 13 21:08:26 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675
Nov 13 21:08:26 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:08:26 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:08:26 user nova-compute[75239]: FIRMWARE:
Nov 13 21:08:26 user nova-compute[75239]: No targets found.
Nov 13 21:08:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:08:26 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:08:26 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e058727-2e75-423d-97f4-41a30113fd1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[586d1bff-474d-4163-af0a-6fa916f71d82]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:08:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:08:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605c8f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0644d72d-5849-442e-a83f-8d2f6726eb51]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82b44d0-29ef-4b39-826e-90e34b458fb2]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2602b1b-5af0-4ab7-a548-f061c7d4bd45]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[014239c9-8133-442d-9667-761f2b8f66da]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcb736f-68fb-475c-8e3e-c068b6741d9e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad52780-86c7-40e6-8df4-fafe9be6b53c]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260]
Nov 13 21:08:26 user nova-compute[75239]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260] successful.
Nov 13 21:08:26 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ef5ac-4506-4c72-9d72-11829853ae86]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== disconnect_volume: return (315ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:08:26 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:08:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Deleting instance files /opt/stack/data/nova/instances/e1774bee-0adc-4b27-baf2-7928c7e31343_del
Nov 13 21:08:26 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Deletion of /opt/stack/data/nova/instances/e1774bee-0adc-4b27-baf2-7928c7e31343_del complete
Nov 13 21:08:27 user nova-compute[75239]: INFO nova.compute.manager [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-unplugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] No waiting events found dispatching network-vif-unplugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-unplugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] No waiting events found dispatching network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:08:27 user nova-compute[75239]: WARNING nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received unexpected event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b for instance with vm_state active and task_state deleting.
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] No waiting events found dispatching network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:08:27 user nova-compute[75239]: WARNING nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received unexpected event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b for instance with vm_state active and task_state deleting.
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] No waiting events found dispatching network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:08:27 user nova-compute[75239]: WARNING nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received unexpected event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b for instance with vm_state active and task_state deleting.
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-unplugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] No waiting events found dispatching network-vif-unplugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-254356a9-3420-4a54-be4a-7a466994634a req-cc557d08-b932-444e-97ea-55780c1c2425 service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-unplugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:08:27 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:08:28 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Took 0.89 seconds to deallocate network for instance.
Nov 13 21:08:28 user nova-compute[75239]: DEBUG nova.compute.manager [req-85e28a4d-856c-4db6-b39f-e64839bfd13e req-b527d12e-bc40-4aa0-ab16-d52e6d26562c service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-deleted-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:08:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:28 user nova-compute[75239]: INFO nova.compute.manager [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Took 0.76 seconds to detach 1 volumes for instance.
Nov 13 21:08:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:28 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:08:28 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:08:28 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:28 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Deleted allocations for instance e1774bee-0adc-4b27-baf2-7928c7e31343
Nov 13 21:08:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-224ee60b-7e18-4aca-bbb9-d3ee3f43ac09 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.188s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-31581ad9-a2f5-4bcf-bb22-4a6c2b075257 req-751e8b27-6c39-4c58-9d21-826190f90afc service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:08:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-31581ad9-a2f5-4bcf-bb22-4a6c2b075257 req-751e8b27-6c39-4c58-9d21-826190f90afc service nova] Acquiring lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-31581ad9-a2f5-4bcf-bb22-4a6c2b075257 req-751e8b27-6c39-4c58-9d21-826190f90afc service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:29 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-31581ad9-a2f5-4bcf-bb22-4a6c2b075257 req-751e8b27-6c39-4c58-9d21-826190f90afc service nova] Lock "e1774bee-0adc-4b27-baf2-7928c7e31343-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:29 user nova-compute[75239]: DEBUG nova.compute.manager [req-31581ad9-a2f5-4bcf-bb22-4a6c2b075257 req-751e8b27-6c39-4c58-9d21-826190f90afc service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] No waiting events found dispatching network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:08:29 user nova-compute[75239]: WARNING nova.compute.manager [req-31581ad9-a2f5-4bcf-bb22-4a6c2b075257 req-751e8b27-6c39-4c58-9d21-826190f90afc service nova] [instance: e1774bee-0adc-4b27-baf2-7928c7e31343] Received unexpected event network-vif-plugged-7c7169e4-c5dd-4c42-b9ee-4d4a8789829b for instance with vm_state deleted and task_state None.
Nov 13 21:08:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:08:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:08:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:08:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:08:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:08:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:08:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:08:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:08:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:08:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:51 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:08:51 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:08:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9162MB free_disk=24.959022521972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 21:08:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 21:08:52 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 21:08:52 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:08:52 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:08:52 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:08:52 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:08:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:08:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:08:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:08:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:08:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:08:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:08:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:08:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:08:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:00 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:09:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:01 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:03 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:09:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:09:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 21:09:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 21:09:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 21:09:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:09:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:09 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 21:09:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:16 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:09:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "809806ec-8a14-4888-a43f-35e0e07cefd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 21:09:17 user nova-compute[75239]: INFO nova.compute.claims [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Claim successful on node user
Nov 13 21:09:17 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.190s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 21:09:17 user nova-compute[75239]: DEBUG nova.network.neutron [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 21:09:17 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 21:09:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 21:09:18 user nova-compute[75239]: INFO nova.virt.block_device [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Booting with volume f222e2fb-0c96-481d-a54a-0f3a10f32675 at /dev/vda
Nov 13 21:09:18 user nova-compute[75239]: DEBUG os_brick.utils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[91642fce-93c8-4209-9053-42629780d702]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dd0eaf-9e05-408e-ace6-acd2d540d21c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3ef914-c3ce-4f0c-aed9-06b20897b974]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e51bb9b-1981-4002-bb18-d8a98886df91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:09:18 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:09:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9ac353-7182-41f1-9bfd-ac92c2fb0175]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG os_brick.utils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating existing volume attachment record: 998049ea-3d25-4e89-ac77-2ee9b9f75bb7 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:09:18 user nova-compute[75239]: DEBUG nova.policy [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e1458f29bb94b0abd4b75ac943fb531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc5530ef3c040dd82883043dabc4c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 21:09:19 user nova-compute[75239]: DEBUG nova.network.neutron [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Successfully created port: c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 21:09:19 user nova-compute[75239]: DEBUG nova.network.neutron [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Successfully updated port: c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 21:09:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:09:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquired lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:09:19 user nova-compute[75239]: DEBUG nova.network.neutron [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 21:09:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-41f83a5d-ca3b-4f30-a536-60f02dda6d94 req-811aeb06-69ad-4902-b76d-253fc674a630 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received event network-changed-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:09:19 user nova-compute[75239]: DEBUG nova.compute.manager [req-41f83a5d-ca3b-4f30-a536-60f02dda6d94 req-811aeb06-69ad-4902-b76d-253fc674a630 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Refreshing instance network info cache due to event network-changed-c6455c55-d536-4edc-a474-84d80eb668bb. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:09:19 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-41f83a5d-ca3b-4f30-a536-60f02dda6d94 req-811aeb06-69ad-4902-b76d-253fc674a630 service nova] Acquiring lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG nova.network.neutron [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG nova.network.neutron [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating instance_info_cache with network_info: [{"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Releasing lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Instance network_info: |[{"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-41f83a5d-ca3b-4f30-a536-60f02dda6d94 req-811aeb06-69ad-4902-b76d-253fc674a630 service nova] Acquired lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG nova.network.neutron [req-41f83a5d-ca3b-4f30-a536-60f02dda6d94 req-811aeb06-69ad-4902-b76d-253fc674a630 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Refreshing network info cache for port c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG nova.network.neutron [req-41f83a5d-ca3b-4f30-a536-60f02dda6d94 req-811aeb06-69ad-4902-b76d-253fc674a630 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updated VIF entry in instance network info cache for port c6455c55-d536-4edc-a474-84d80eb668bb. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG nova.network.neutron [req-41f83a5d-ca3b-4f30-a536-60f02dda6d94 req-811aeb06-69ad-4902-b76d-253fc674a630 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating instance_info_cache with network_info: [{"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:09:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-41f83a5d-ca3b-4f30-a536-60f02dda6d94 req-811aeb06-69ad-4902-b76d-253fc674a630 service nova] Releasing lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:09:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:09:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 21:09:22 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Creating image(s)
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Ensure instance console log exists: /opt/stack/data/nova/instances/809806ec-8a14-4888-a43f-35e0e07cefd0/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Start _get_guest_xml network_info=[{"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '998049ea-3d25-4e89-ac77-2ee9b9f75bb7', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpHCQvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '809806ec-8a14-4888-a43f-35e0e07cefd0', 'attached_at': '', 'detached_at': '', 'volume_id': 'f222e2fb-0c96-481d-a54a-0f3a10f32675', 'serial': 'f222e2fb-0c96-481d-a54a-0f3a10f32675'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 21:09:22 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:09:22 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpHCQvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:09:22 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:09:22 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:09:22 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[824aa589-a375-43b1-877e-271a91bb88a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:09:22 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebe3f7f-84d9-4936-9485-04f1c33a1867]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675] added
Nov 13 21:09:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[692a1891-84cd-4359-baf4-9f6383a68198]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5371b422-0814-4092-b44f-46d4ba58bc62]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpHCQvNT {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tpHCQvNT" returned: 0 in 0.102s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[460e8324-299f-4fb9-9be4-034996996df2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tpHCQvNT'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a35847-84f4-4610-9617-f4252556a5cb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a2319c-915a-4ce4-863a-6f301ab18c50]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:09:22 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:09:22 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:09:22 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 21:09:22 user nova-compute[75239]: 
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[190d2516-de4b-40e8-a0c5-785c6aad68ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260]
Nov 13 21:09:22 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260] successful.
Nov 13 21:09:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a30116-dc56-45ea-9a8a-53c5f5044ad8]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1881d213-6d0e-4256-b916-dcddd029091a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:09:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:09:22 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b1b0e3-f67b-4599-af7d-6b3214a09bd9]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:09:22 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpHCQvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23765666234666530', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765666234666530', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-802802704',display_name='tempest-TestVolumeBootPattern-server-802802704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-802802704',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInC+sZCaKDSI50O8C8gGNwh8J8RgdnkdYIEwC/z0KDx2uN6GFrm5Akq9jizFgdrHKLHCMpaEbLx/BZo3JjgjKWbrE7hgTFDncZBWFRtdULHtjLI6ELBo5Oz3EJMja6xow==',key_name='tempest-TestVolumeBootPattern-1106875438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-d6laitfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:09:18Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=809806ec-8a14-4888-a43f-35e0e07cefd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:af:bf,bridge_name='br-int',has_traffic_filtering=True,id=c6455c55-d536-4edc-a474-84d80eb668bb,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6455c55-d5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.objects.instance [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'pci_devices' on Instance uuid 809806ec-8a14-4888-a43f-35e0e07cefd0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 21:09:23 user nova-compute[75239]:   <uuid>809806ec-8a14-4888-a43f-35e0e07cefd0</uuid>
Nov 13 21:09:23 user nova-compute[75239]:   <name>instance-00000033</name>
Nov 13 21:09:23 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 21:09:23 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 21:09:23 user nova-compute[75239]:   <metadata>
Nov 13 21:09:23 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 21:09:23 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 21:09:23 user nova-compute[75239]:       <nova:name>tempest-TestVolumeBootPattern-server-802802704</nova:name>
Nov 13 21:09:23 user nova-compute[75239]:       <nova:creationTime>2023-11-13 21:09:22</nova:creationTime>
Nov 13 21:09:23 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 21:09:23 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 21:09:23 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 21:09:23 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 21:09:23 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 21:09:23 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 21:09:23 user nova-compute[75239]:       </nova:flavor>
Nov 13 21:09:23 user nova-compute[75239]:       <nova:owner>
Nov 13 21:09:23 user nova-compute[75239]:         <nova:user uuid="7e1458f29bb94b0abd4b75ac943fb531">tempest-TestVolumeBootPattern-1828724263-project-member</nova:user>
Nov 13 21:09:23 user nova-compute[75239]:         <nova:project uuid="fbc5530ef3c040dd82883043dabc4c7d">tempest-TestVolumeBootPattern-1828724263</nova:project>
Nov 13 21:09:23 user nova-compute[75239]:       </nova:owner>
Nov 13 21:09:23 user nova-compute[75239]:       <nova:ports>
Nov 13 21:09:23 user nova-compute[75239]:         <nova:port uuid="c6455c55-d536-4edc-a474-84d80eb668bb">
Nov 13 21:09:23 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 21:09:23 user nova-compute[75239]:         </nova:port>
Nov 13 21:09:23 user nova-compute[75239]:       </nova:ports>
Nov 13 21:09:23 user nova-compute[75239]:     </nova:instance>
Nov 13 21:09:23 user nova-compute[75239]:   </metadata>
Nov 13 21:09:23 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 21:09:23 user nova-compute[75239]:     <system>
Nov 13 21:09:23 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 21:09:23 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 21:09:23 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 21:09:23 user nova-compute[75239]:       <entry name="serial">809806ec-8a14-4888-a43f-35e0e07cefd0</entry>
Nov 13 21:09:23 user nova-compute[75239]:       <entry name="uuid">809806ec-8a14-4888-a43f-35e0e07cefd0</entry>
Nov 13 21:09:23 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 21:09:23 user nova-compute[75239]:     </system>
Nov 13 21:09:23 user nova-compute[75239]:   </sysinfo>
Nov 13 21:09:23 user nova-compute[75239]:   <os>
Nov 13 21:09:23 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 21:09:23 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 21:09:23 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 21:09:23 user nova-compute[75239]:   </os>
Nov 13 21:09:23 user nova-compute[75239]:   <features>
Nov 13 21:09:23 user nova-compute[75239]:     <acpi/>
Nov 13 21:09:23 user nova-compute[75239]:     <apic/>
Nov 13 21:09:23 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 21:09:23 user nova-compute[75239]:   </features>
Nov 13 21:09:23 user nova-compute[75239]:   <clock offset="utc">
Nov 13 21:09:23 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 21:09:23 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 21:09:23 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 21:09:23 user nova-compute[75239]:   </clock>
Nov 13 21:09:23 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 21:09:23 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 21:09:23 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 21:09:23 user nova-compute[75239]:   </cpu>
Nov 13 21:09:23 user nova-compute[75239]:   <devices>
Nov 13 21:09:23 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 21:09:23 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:09:23 user nova-compute[75239]:       <source dev="/dev/sdb"/>
Nov 13 21:09:23 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 21:09:23 user nova-compute[75239]:       <serial>f222e2fb-0c96-481d-a54a-0f3a10f32675</serial>
Nov 13 21:09:23 user nova-compute[75239]:     </disk>
Nov 13 21:09:23 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 21:09:23 user nova-compute[75239]:       <mac address="fa:16:3e:ff:af:bf"/>
Nov 13 21:09:23 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:09:23 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 21:09:23 user nova-compute[75239]:       <target dev="tapc6455c55-d5"/>
Nov 13 21:09:23 user nova-compute[75239]:     </interface>
Nov 13 21:09:23 user nova-compute[75239]:     <serial type="pty">
Nov 13 21:09:23 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/809806ec-8a14-4888-a43f-35e0e07cefd0/console.log" append="off"/>
Nov 13 21:09:23 user nova-compute[75239]:     </serial>
Nov 13 21:09:23 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 21:09:23 user nova-compute[75239]:     <video>
Nov 13 21:09:23 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:09:23 user nova-compute[75239]:     </video>
Nov 13 21:09:23 user nova-compute[75239]:     <rng model="virtio">
Nov 13 21:09:23 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 21:09:23 user nova-compute[75239]:     </rng>
Nov 13 21:09:23 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 21:09:23 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 21:09:23 user nova-compute[75239]:       <stats period="10"/>
Nov 13 21:09:23 user nova-compute[75239]:     </memballoon>
Nov 13 21:09:23 user nova-compute[75239]:   </devices>
Nov 13 21:09:23 user nova-compute[75239]: </domain>
Nov 13 21:09:23 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-802802704',display_name='tempest-TestVolumeBootPattern-server-802802704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-802802704',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInC+sZCaKDSI50O8C8gGNwh8J8RgdnkdYIEwC/z0KDx2uN6GFrm5Akq9jizFgdrHKLHCMpaEbLx/BZo3JjgjKWbrE7hgTFDncZBWFRtdULHtjLI6ELBo5Oz3EJMja6xow==',key_name='tempest-TestVolumeBootPattern-1106875438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-d6laitfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:09:18Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=809806ec-8a14-4888-a43f-35e0e07cefd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:af:bf,bridge_name='br-int',has_traffic_filtering=True,id=c6455c55-d536-4edc-a474-84d80eb668bb,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6455c55-d5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG os_vif [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:af:bf,bridge_name='br-int',has_traffic_filtering=True,id=c6455c55-d536-4edc-a474-84d80eb668bb,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6455c55-d5') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2191ffcd-1d6e-53ca-9823-625812166192', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6455c55-d5, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6455c55-d5, col_values=(('qos', UUID('38e68421-52ac-47a8-9661-75ee7e87057a')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6455c55-d5, col_values=(('external_ids', {'iface-id': 'c6455c55-d536-4edc-a474-84d80eb668bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:af:bf', 'vm-uuid': '809806ec-8a14-4888-a43f-35e0e07cefd0'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:23 user nova-compute[75239]: INFO os_vif [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:af:bf,bridge_name='br-int',has_traffic_filtering=True,id=c6455c55-d536-4edc-a474-84d80eb668bb,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6455c55-d5')
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:09:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No VIF found with MAC fa:16:3e:ff:af:bf, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-5b2501f0-1a86-4e22-b2d6-70f5c7bfd802 req-5137279a-12cc-45c9-b160-75eed2bedeb1 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received event network-vif-plugged-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5b2501f0-1a86-4e22-b2d6-70f5c7bfd802 req-5137279a-12cc-45c9-b160-75eed2bedeb1 service nova] Acquiring lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5b2501f0-1a86-4e22-b2d6-70f5c7bfd802 req-5137279a-12cc-45c9-b160-75eed2bedeb1 service nova] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5b2501f0-1a86-4e22-b2d6-70f5c7bfd802 req-5137279a-12cc-45c9-b160-75eed2bedeb1 service nova] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG nova.compute.manager [req-5b2501f0-1a86-4e22-b2d6-70f5c7bfd802 req-5137279a-12cc-45c9-b160-75eed2bedeb1 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] No waiting events found dispatching network-vif-plugged-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:09:25 user nova-compute[75239]: WARNING nova.compute.manager [req-5b2501f0-1a86-4e22-b2d6-70f5c7bfd802 req-5137279a-12cc-45c9-b160-75eed2bedeb1 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received unexpected event network-vif-plugged-c6455c55-d536-4edc-a474-84d80eb668bb for instance with vm_state building and task_state spawning.
Nov 13 21:09:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 21:09:27 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Instance spawned successfully.
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:09:27 user nova-compute[75239]: INFO nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-2344c224-78a9-45a4-81cb-14b0deceb68b req-db65ed79-7d73-4499-aa70-432584ddba6e service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received event network-vif-plugged-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2344c224-78a9-45a4-81cb-14b0deceb68b req-db65ed79-7d73-4499-aa70-432584ddba6e service nova] Acquiring lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2344c224-78a9-45a4-81cb-14b0deceb68b req-db65ed79-7d73-4499-aa70-432584ddba6e service nova] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-2344c224-78a9-45a4-81cb-14b0deceb68b req-db65ed79-7d73-4499-aa70-432584ddba6e service nova] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:09:27 user nova-compute[75239]: DEBUG nova.compute.manager [req-2344c224-78a9-45a4-81cb-14b0deceb68b req-db65ed79-7d73-4499-aa70-432584ddba6e service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] No waiting events found dispatching network-vif-plugged-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:09:27 user nova-compute[75239]: WARNING nova.compute.manager [req-2344c224-78a9-45a4-81cb-14b0deceb68b req-db65ed79-7d73-4499-aa70-432584ddba6e service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received unexpected event network-vif-plugged-c6455c55-d536-4edc-a474-84d80eb668bb for instance with vm_state building and task_state spawning.
Nov 13 21:09:27 user nova-compute[75239]: INFO nova.compute.manager [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Took 9.75 seconds to build instance.
Nov 13 21:09:27 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-04bcd67d-ed0e-424b-a99b-109c3876e585 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.848s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:09:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:09:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:09:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:09:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:09:51 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:09:51 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=24.95736312866211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 809806ec-8a14-4888-a43f-35e0e07cefd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:09:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:09:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:09:58 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:58 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:09:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:10:02 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:10:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:10:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 809806ec-8a14-4888-a43f-35e0e07cefd0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating instance_info_cache with network_info: [{"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:10:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:10:07 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:10:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:10:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:10:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:10:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:10:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:10:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:10:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:10:51 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:10:51 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:10:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9036MB free_disk=24.956745147705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 809806ec-8a14-4888-a43f-35e0e07cefd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:10:51 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:10:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:10:53 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:10:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:10:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:10:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:10:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:10:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:10:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:11:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:11:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:11:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:11:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:11:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:11:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 809806ec-8a14-4888-a43f-35e0e07cefd0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating instance_info_cache with network_info: [{"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:11:05 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:11:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:11:07 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:11:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-c90138a3-a41b-44c2-b117-4c404d6d31e5 req-5c3583df-2995-46f7-a997-944d21720b55 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received event network-changed-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:11:09 user nova-compute[75239]: DEBUG nova.compute.manager [req-c90138a3-a41b-44c2-b117-4c404d6d31e5 req-5c3583df-2995-46f7-a997-944d21720b55 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Refreshing instance network info cache due to event network-changed-c6455c55-d536-4edc-a474-84d80eb668bb. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:11:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c90138a3-a41b-44c2-b117-4c404d6d31e5 req-5c3583df-2995-46f7-a997-944d21720b55 service nova] Acquiring lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:11:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c90138a3-a41b-44c2-b117-4c404d6d31e5 req-5c3583df-2995-46f7-a997-944d21720b55 service nova] Acquired lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:11:09 user nova-compute[75239]: DEBUG nova.network.neutron [req-c90138a3-a41b-44c2-b117-4c404d6d31e5 req-5c3583df-2995-46f7-a997-944d21720b55 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Refreshing network info cache for port c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:11:09 user nova-compute[75239]: DEBUG nova.network.neutron [req-c90138a3-a41b-44c2-b117-4c404d6d31e5 req-5c3583df-2995-46f7-a997-944d21720b55 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updated VIF entry in instance network info cache for port c6455c55-d536-4edc-a474-84d80eb668bb. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:11:09 user nova-compute[75239]: DEBUG nova.network.neutron [req-c90138a3-a41b-44c2-b117-4c404d6d31e5 req-5c3583df-2995-46f7-a997-944d21720b55 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating instance_info_cache with network_info: [{"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:11:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c90138a3-a41b-44c2-b117-4c404d6d31e5 req-5c3583df-2995-46f7-a997-944d21720b55 service nova] Releasing lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 21:11:13 user nova-compute[75239]: INFO nova.compute.claims [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Claim successful on node user
Nov 13 21:11:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 21:11:13 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 21:11:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG nova.policy [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e1458f29bb94b0abd4b75ac943fb531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbc5530ef3c040dd82883043dabc4c7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 21:11:14 user nova-compute[75239]: INFO nova.virt.block_device [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Booting with volume e411b792-4b85-4b16-b05a-0cea04f3fcb5 at /dev/vda
Nov 13 21:11:14 user nova-compute[75239]: DEBUG os_brick.utils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f455d950-2dab-422b-8da9-2743e238be3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e223f1b-79a7-4015-a699-48c89cc8ee45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc23c3-1463-4f4a-ae2b-da165d89d5bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e0b4e6-f5d6-43d3-a5aa-ab9edd0956e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:11:14 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:11:14 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[896329a4-38f6-4abd-97e4-3804c0066d32]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG os_brick.utils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Updating existing volume attachment record: 87663caf-9dfe-49b2-a11e-1627246c9d8d {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:11:14 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Successfully created port: efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Successfully updated port: efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquired lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-5894a925-47f1-41b8-a2f7-40841a74add3 req-c886808b-343d-4a47-b0e7-7c0f8650e6da service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received event network-changed-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.compute.manager [req-5894a925-47f1-41b8-a2f7-40841a74add3 req-c886808b-343d-4a47-b0e7-7c0f8650e6da service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Refreshing instance network info cache due to event network-changed-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5894a925-47f1-41b8-a2f7-40841a74add3 req-c886808b-343d-4a47-b0e7-7c0f8650e6da service nova] Acquiring lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Updating instance_info_cache with network_info: [{"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Releasing lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Instance network_info: |[{"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5894a925-47f1-41b8-a2f7-40841a74add3 req-c886808b-343d-4a47-b0e7-7c0f8650e6da service nova] Acquired lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.network.neutron [req-5894a925-47f1-41b8-a2f7-40841a74add3 req-c886808b-343d-4a47-b0e7-7c0f8650e6da service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Refreshing network info cache for port efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.network.neutron [req-5894a925-47f1-41b8-a2f7-40841a74add3 req-c886808b-343d-4a47-b0e7-7c0f8650e6da service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Updated VIF entry in instance network info cache for port efa28b28-671b-4eb3-8c4f-14f59d5ce0ab. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG nova.network.neutron [req-5894a925-47f1-41b8-a2f7-40841a74add3 req-c886808b-343d-4a47-b0e7-7c0f8650e6da service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Updating instance_info_cache with network_info: [{"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:11:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-5894a925-47f1-41b8-a2f7-40841a74add3 req-c886808b-343d-4a47-b0e7-7c0f8650e6da service nova] Releasing lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 21:11:18 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Creating image(s)
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Did not create local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Ensure instance console log exists: /opt/stack/data/nova/instances/470352e3-0bab-4cdc-a6a9-7539b5fd1553/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Start _get_guest_xml network_info=[{"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '87663caf-9dfe-49b2-a11e-1627246c9d8d', 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhgaUCoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '470352e3-0bab-4cdc-a6a9-7539b5fd1553', 'attached_at': '', 'detached_at': '', 'volume_id': 'e411b792-4b85-4b16-b05a-0cea04f3fcb5', 'serial': 'e411b792-4b85-4b16-b05a-0cea04f3fcb5'}, 'guest_format': None, 'volume_type': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 21:11:18 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:11:18 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhgaUCoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:11:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:11:18 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:11:18 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db36f80-d314-40aa-883b-d150ae8abb02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:11:18 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a19698c-1fe9-4461-a99d-067598af5f29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5] added
Nov 13 21:11:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b29be-c66a-4b5f-b59f-873c7cfbc41d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fd24a3-78c6-4d33-91cd-29ae98343c89]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhgaUCoX {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhgaUCoX" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[493e3ead-71c6-4a18-8980-087824183c5d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhgaUCoX'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c48adf6-d275-4fb9-a14b-22df007683f2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2083ef-b919-40f2-934d-ac29f1760247]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:11:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:11:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ea5c24-468c-45be-95b8-457d564a97c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5, portal: 172.16.0.220,3260]
Nov 13 21:11:18 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5, portal: 172.16.0.220,3260] successful.
Nov 13 21:11:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8764f43-eadc-4b58-b0c0-8b0957dc59ba]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e695e182-d5df-4b92-9a4f-b3a521f49191]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:11:18 user nova-compute[75239]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 (non-flash)
Nov 13 21:11:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:11:18 user nova-compute[75239]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 (non-flash)
Nov 13 21:11:18 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae09edad-4d76-4b78-86e2-7013213344ec]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhgaUCoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26638363861376139', 'path': '/dev/sdc'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638363861376139', 'path': '/dev/sdc'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-964988570',display_name='tempest-TestVolumeBootPattern-server-964988570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-964988570',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInC+sZCaKDSI50O8C8gGNwh8J8RgdnkdYIEwC/z0KDx2uN6GFrm5Akq9jizFgdrHKLHCMpaEbLx/BZo3JjgjKWbrE7hgTFDncZBWFRtdULHtjLI6ELBo5Oz3EJMja6xow==',key_name='tempest-TestVolumeBootPattern-1106875438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-369mgjvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:11:14Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=470352e3-0bab-4cdc-a6a9-7539b5fd1553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=efa28b28-671b-4eb3-8c4f-14f59d5ce0ab,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa28b28-67') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.objects.instance [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'pci_devices' on Instance uuid 470352e3-0bab-4cdc-a6a9-7539b5fd1553 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] End _get_guest_xml xml=<domain type="kvm">
Nov 13 21:11:19 user nova-compute[75239]:   <uuid>470352e3-0bab-4cdc-a6a9-7539b5fd1553</uuid>
Nov 13 21:11:19 user nova-compute[75239]:   <name>instance-00000034</name>
Nov 13 21:11:19 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 21:11:19 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 21:11:19 user nova-compute[75239]:   <metadata>
Nov 13 21:11:19 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 21:11:19 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 21:11:19 user nova-compute[75239]:       <nova:name>tempest-TestVolumeBootPattern-server-964988570</nova:name>
Nov 13 21:11:19 user nova-compute[75239]:       <nova:creationTime>2023-11-13 21:11:18</nova:creationTime>
Nov 13 21:11:19 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 21:11:19 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 21:11:19 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 21:11:19 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 21:11:19 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 21:11:19 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 21:11:19 user nova-compute[75239]:       </nova:flavor>
Nov 13 21:11:19 user nova-compute[75239]:       <nova:owner>
Nov 13 21:11:19 user nova-compute[75239]:         <nova:user uuid="7e1458f29bb94b0abd4b75ac943fb531">tempest-TestVolumeBootPattern-1828724263-project-member</nova:user>
Nov 13 21:11:19 user nova-compute[75239]:         <nova:project uuid="fbc5530ef3c040dd82883043dabc4c7d">tempest-TestVolumeBootPattern-1828724263</nova:project>
Nov 13 21:11:19 user nova-compute[75239]:       </nova:owner>
Nov 13 21:11:19 user nova-compute[75239]:       <nova:ports>
Nov 13 21:11:19 user nova-compute[75239]:         <nova:port uuid="efa28b28-671b-4eb3-8c4f-14f59d5ce0ab">
Nov 13 21:11:19 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 21:11:19 user nova-compute[75239]:         </nova:port>
Nov 13 21:11:19 user nova-compute[75239]:       </nova:ports>
Nov 13 21:11:19 user nova-compute[75239]:     </nova:instance>
Nov 13 21:11:19 user nova-compute[75239]:   </metadata>
Nov 13 21:11:19 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 21:11:19 user nova-compute[75239]:     <system>
Nov 13 21:11:19 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 21:11:19 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 21:11:19 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 21:11:19 user nova-compute[75239]:       <entry name="serial">470352e3-0bab-4cdc-a6a9-7539b5fd1553</entry>
Nov 13 21:11:19 user nova-compute[75239]:       <entry name="uuid">470352e3-0bab-4cdc-a6a9-7539b5fd1553</entry>
Nov 13 21:11:19 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 21:11:19 user nova-compute[75239]:     </system>
Nov 13 21:11:19 user nova-compute[75239]:   </sysinfo>
Nov 13 21:11:19 user nova-compute[75239]:   <os>
Nov 13 21:11:19 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 21:11:19 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 21:11:19 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 21:11:19 user nova-compute[75239]:   </os>
Nov 13 21:11:19 user nova-compute[75239]:   <features>
Nov 13 21:11:19 user nova-compute[75239]:     <acpi/>
Nov 13 21:11:19 user nova-compute[75239]:     <apic/>
Nov 13 21:11:19 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 21:11:19 user nova-compute[75239]:   </features>
Nov 13 21:11:19 user nova-compute[75239]:   <clock offset="utc">
Nov 13 21:11:19 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 21:11:19 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 21:11:19 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 21:11:19 user nova-compute[75239]:   </clock>
Nov 13 21:11:19 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 21:11:19 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 21:11:19 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 21:11:19 user nova-compute[75239]:   </cpu>
Nov 13 21:11:19 user nova-compute[75239]:   <devices>
Nov 13 21:11:19 user nova-compute[75239]:     <disk type="block" device="disk">
Nov 13 21:11:19 user nova-compute[75239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:11:19 user nova-compute[75239]:       <source dev="/dev/sdc"/>
Nov 13 21:11:19 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 21:11:19 user nova-compute[75239]:       <serial>e411b792-4b85-4b16-b05a-0cea04f3fcb5</serial>
Nov 13 21:11:19 user nova-compute[75239]:     </disk>
Nov 13 21:11:19 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 21:11:19 user nova-compute[75239]:       <mac address="fa:16:3e:d6:ab:57"/>
Nov 13 21:11:19 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:11:19 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 21:11:19 user nova-compute[75239]:       <target dev="tapefa28b28-67"/>
Nov 13 21:11:19 user nova-compute[75239]:     </interface>
Nov 13 21:11:19 user nova-compute[75239]:     <serial type="pty">
Nov 13 21:11:19 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/470352e3-0bab-4cdc-a6a9-7539b5fd1553/console.log" append="off"/>
Nov 13 21:11:19 user nova-compute[75239]:     </serial>
Nov 13 21:11:19 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 21:11:19 user nova-compute[75239]:     <video>
Nov 13 21:11:19 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:11:19 user nova-compute[75239]:     </video>
Nov 13 21:11:19 user nova-compute[75239]:     <rng model="virtio">
Nov 13 21:11:19 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 21:11:19 user nova-compute[75239]:     </rng>
Nov 13 21:11:19 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 21:11:19 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 21:11:19 user nova-compute[75239]:       <stats period="10"/>
Nov 13 21:11:19 user nova-compute[75239]:     </memballoon>
Nov 13 21:11:19 user nova-compute[75239]:   </devices>
Nov 13 21:11:19 user nova-compute[75239]: </domain>
Nov 13 21:11:19 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-964988570',display_name='tempest-TestVolumeBootPattern-server-964988570',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-964988570',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInC+sZCaKDSI50O8C8gGNwh8J8RgdnkdYIEwC/z0KDx2uN6GFrm5Akq9jizFgdrHKLHCMpaEbLx/BZo3JjgjKWbrE7hgTFDncZBWFRtdULHtjLI6ELBo5Oz3EJMja6xow==',key_name='tempest-TestVolumeBootPattern-1106875438',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-369mgjvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:11:14Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=470352e3-0bab-4cdc-a6a9-7539b5fd1553,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=efa28b28-671b-4eb3-8c4f-14f59d5ce0ab,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa28b28-67') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG os_vif [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=efa28b28-671b-4eb3-8c4f-14f59d5ce0ab,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa28b28-67') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23800c32-6c72-5a0b-a511-e5a0e553e127', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapefa28b28-67, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapefa28b28-67, col_values=(('qos', UUID('adad104c-f0da-4a63-b647-99471e35076e')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapefa28b28-67, col_values=(('external_ids', {'iface-id': 'efa28b28-671b-4eb3-8c4f-14f59d5ce0ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:ab:57', 'vm-uuid': '470352e3-0bab-4cdc-a6a9-7539b5fd1553'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:19 user nova-compute[75239]: INFO os_vif [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=efa28b28-671b-4eb3-8c4f-14f59d5ce0ab,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa28b28-67')
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:11:19 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] No VIF found with MAC fa:16:3e:d6:ab:57, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:11:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-907c658d-fc27-49dc-83dc-e78b4ceffd3a req-17652660-38cd-4ef3-9168-a2643586f0b5 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received event network-vif-plugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:11:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-907c658d-fc27-49dc-83dc-e78b4ceffd3a req-17652660-38cd-4ef3-9168-a2643586f0b5 service nova] Acquiring lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:11:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-907c658d-fc27-49dc-83dc-e78b4ceffd3a req-17652660-38cd-4ef3-9168-a2643586f0b5 service nova] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:11:21 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-907c658d-fc27-49dc-83dc-e78b4ceffd3a req-17652660-38cd-4ef3-9168-a2643586f0b5 service nova] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:11:21 user nova-compute[75239]: DEBUG nova.compute.manager [req-907c658d-fc27-49dc-83dc-e78b4ceffd3a req-17652660-38cd-4ef3-9168-a2643586f0b5 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] No waiting events found dispatching network-vif-plugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:11:21 user nova-compute[75239]: WARNING nova.compute.manager [req-907c658d-fc27-49dc-83dc-e78b4ceffd3a req-17652660-38cd-4ef3-9168-a2643586f0b5 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received unexpected event network-vif-plugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab for instance with vm_state building and task_state spawning.
Nov 13 21:11:22 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 21:11:23 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Instance spawned successfully.
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:11:23 user nova-compute[75239]: INFO nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 21:11:23 user nova-compute[75239]: INFO nova.compute.manager [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Took 9.82 seconds to build instance.
Nov 13 21:11:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c73a0ed4-755a-4d82-9139-45a84f409675 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.922s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-859b2646-4c57-4080-9f67-5378e86d88da req-57a52e35-27a7-4911-9ebd-2517c74dfab6 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received event network-vif-plugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-859b2646-4c57-4080-9f67-5378e86d88da req-57a52e35-27a7-4911-9ebd-2517c74dfab6 service nova] Acquiring lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-859b2646-4c57-4080-9f67-5378e86d88da req-57a52e35-27a7-4911-9ebd-2517c74dfab6 service nova] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-859b2646-4c57-4080-9f67-5378e86d88da req-57a52e35-27a7-4911-9ebd-2517c74dfab6 service nova] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:11:23 user nova-compute[75239]: DEBUG nova.compute.manager [req-859b2646-4c57-4080-9f67-5378e86d88da req-57a52e35-27a7-4911-9ebd-2517c74dfab6 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] No waiting events found dispatching network-vif-plugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:11:23 user nova-compute[75239]: WARNING nova.compute.manager [req-859b2646-4c57-4080-9f67-5378e86d88da req-57a52e35-27a7-4911-9ebd-2517c74dfab6 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received unexpected event network-vif-plugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab for instance with vm_state active and task_state None.
Nov 13 21:11:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:53 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:11:53 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=24.95496368408203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 809806ec-8a14-4888-a43f-35e0e07cefd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 470352e3-0bab-4cdc-a6a9-7539b5fd1553 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:11:53 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:11:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:54 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:11:54 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:11:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:11:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:00 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:12:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:12:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:12:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 809806ec-8a14-4888-a43f-35e0e07cefd0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating instance_info_cache with network_info: [{"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:12:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:12:07 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:12:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:12:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:12:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:12:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:12:09 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:14 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:19 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:12:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:29 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:39 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:49 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:12:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:12:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:12:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:12:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:12:55 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:12:55 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=24.95431900024414GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 809806ec-8a14-4888-a43f-35e0e07cefd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 470352e3-0bab-4cdc-a6a9-7539b5fd1553 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:12:55 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:12:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:02 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:04 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-168133d0-3bc8-444f-aefe-bf5314fa3899 req-c1537f5e-ff86-44b1-b14c-6998d02d08f9 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received event network-changed-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG nova.compute.manager [req-168133d0-3bc8-444f-aefe-bf5314fa3899 req-c1537f5e-ff86-44b1-b14c-6998d02d08f9 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Refreshing instance network info cache due to event network-changed-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-168133d0-3bc8-444f-aefe-bf5314fa3899 req-c1537f5e-ff86-44b1-b14c-6998d02d08f9 service nova] Acquiring lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-168133d0-3bc8-444f-aefe-bf5314fa3899 req-c1537f5e-ff86-44b1-b14c-6998d02d08f9 service nova] Acquired lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG nova.network.neutron [req-168133d0-3bc8-444f-aefe-bf5314fa3899 req-c1537f5e-ff86-44b1-b14c-6998d02d08f9 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Refreshing network info cache for port efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG nova.network.neutron [req-168133d0-3bc8-444f-aefe-bf5314fa3899 req-c1537f5e-ff86-44b1-b14c-6998d02d08f9 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Updated VIF entry in instance network info cache for port efa28b28-671b-4eb3-8c4f-14f59d5ce0ab. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG nova.network.neutron [req-168133d0-3bc8-444f-aefe-bf5314fa3899 req-c1537f5e-ff86-44b1-b14c-6998d02d08f9 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Updating instance_info_cache with network_info: [{"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-168133d0-3bc8-444f-aefe-bf5314fa3899 req-c1537f5e-ff86-44b1-b14c-6998d02d08f9 service nova] Releasing lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:05 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:13:06 user nova-compute[75239]: INFO nova.compute.manager [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Terminating instance
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Skipping network cache update for instance because it is being deleted. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-b886cd1c-9e0d-4362-975a-b7e313df157b req-6a236b75-73cf-41b2-b2a8-462aad19ed7d service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received event network-vif-unplugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b886cd1c-9e0d-4362-975a-b7e313df157b req-6a236b75-73cf-41b2-b2a8-462aad19ed7d service nova] Acquiring lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b886cd1c-9e0d-4362-975a-b7e313df157b req-6a236b75-73cf-41b2-b2a8-462aad19ed7d service nova] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-b886cd1c-9e0d-4362-975a-b7e313df157b req-6a236b75-73cf-41b2-b2a8-462aad19ed7d service nova] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-b886cd1c-9e0d-4362-975a-b7e313df157b req-6a236b75-73cf-41b2-b2a8-462aad19ed7d service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] No waiting events found dispatching network-vif-unplugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.compute.manager [req-b886cd1c-9e0d-4362-975a-b7e313df157b req-6a236b75-73cf-41b2-b2a8-462aad19ed7d service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received event network-vif-unplugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:06 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Instance destroyed successfully.
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'resources' on Instance uuid 470352e3-0bab-4cdc-a6a9-7539b5fd1553 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:11:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-964988570',display_name='tempest-TestVolumeBootPattern-server-964988570',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-964988570',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInC+sZCaKDSI50O8C8gGNwh8J8RgdnkdYIEwC/z0KDx2uN6GFrm5Akq9jizFgdrHKLHCMpaEbLx/BZo3JjgjKWbrE7hgTFDncZBWFRtdULHtjLI6ELBo5Oz3EJMja6xow==',key_name='tempest-TestVolumeBootPattern-1106875438',keypairs=<?>,launch_index=0,launched_at=2023-11-13T21:11:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-369mgjvq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T21:11:23Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=470352e3-0bab-4cdc-a6a9-7539b5fd1553,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=efa28b28-671b-4eb3-8c4f-14f59d5ce0ab,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa28b28-67') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_vif [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=efa28b28-671b-4eb3-8c4f-14f59d5ce0ab,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa28b28-67') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapefa28b28-67, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adad104c-f0da-4a63-b647-99471e35076e) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:13:06 user nova-compute[75239]: INFO os_vif [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:ab:57,bridge_name='br-int',has_traffic_filtering=True,id=efa28b28-671b-4eb3-8c4f-14f59d5ce0ab,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapefa28b28-67')
Nov 13 21:13:06 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhgaUCoX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:13:06 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5573780-9f85-469a-b4a2-d69476b62116]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:13:06 user nova-compute[75239]: No targets found.
Nov 13 21:13:06 user nova-compute[75239]: iSNS:
Nov 13 21:13:06 user nova-compute[75239]: No targets found.
Nov 13 21:13:06 user nova-compute[75239]: STATIC:
Nov 13 21:13:06 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5
Nov 13 21:13:06 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:13:06 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:13:06 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675
Nov 13 21:13:06 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:13:06 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:13:06 user nova-compute[75239]: FIRMWARE:
Nov 13 21:13:06 user nova-compute[75239]: No targets found.
Nov 13 21:13:06 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:13:06 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:13:06 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0c8a7b-c333-49ec-96a7-69cfa31140fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eb0fe6-dadc-441c-91e8-060b635fd649]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:13:06 user nova-compute[75239]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 (non-flash)
Nov 13 21:13:06 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:13:06 user nova-compute[75239]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 (non-flash)
Nov 13 21:13:06 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d603d0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5'): ({'sdc'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Removing single pathed devices sdc {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cfff04-0260-41c7-9631-451678b11bbb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfa5acb-0afe-463f-8203-99b64adcd7ab]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flushing IO for device /dev/sdc {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a718e41a-07f5-4785-90a8-a73d0b3e15c3]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:13:06 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a468368-d938-4eed-a365-4fb41901c40f]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] SCSI volumes sdc have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb8c7ae-d7f8-4461-8d14-bf65534f9694]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78744765-8527-4773-be14-b0462fc9a5ce]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5, portal: 172.16.0.220,3260]
Nov 13 21:13:07 user nova-compute[75239]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5, portal: 172.16.0.220,3260] successful.
Nov 13 21:13:07 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e411b792-4b85-4b16-b05a-0cea04f3fcb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd28498-85d3-4ee2-b6bf-43aa6897aac2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== disconnect_volume: return (278ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:13:07 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Deleting instance files /opt/stack/data/nova/instances/470352e3-0bab-4cdc-a6a9-7539b5fd1553_del
Nov 13 21:13:07 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Deletion of /opt/stack/data/nova/instances/470352e3-0bab-4cdc-a6a9-7539b5fd1553_del complete
Nov 13 21:13:07 user nova-compute[75239]: INFO nova.compute.manager [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-536e9eee-cae0-4336-be2b-58558dd4cf03 req-e0f23b2f-612b-4fef-8742-56b2a7fa29ee service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received event network-changed-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-536e9eee-cae0-4336-be2b-58558dd4cf03 req-e0f23b2f-612b-4fef-8742-56b2a7fa29ee service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Refreshing instance network info cache due to event network-changed-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-536e9eee-cae0-4336-be2b-58558dd4cf03 req-e0f23b2f-612b-4fef-8742-56b2a7fa29ee service nova] Acquiring lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-536e9eee-cae0-4336-be2b-58558dd4cf03 req-e0f23b2f-612b-4fef-8742-56b2a7fa29ee service nova] Acquired lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-536e9eee-cae0-4336-be2b-58558dd4cf03 req-e0f23b2f-612b-4fef-8742-56b2a7fa29ee service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Refreshing network info cache for port efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-536e9eee-cae0-4336-be2b-58558dd4cf03 req-e0f23b2f-612b-4fef-8742-56b2a7fa29ee service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Updated VIF entry in instance network info cache for port efa28b28-671b-4eb3-8c4f-14f59d5ce0ab. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.network.neutron [req-536e9eee-cae0-4336-be2b-58558dd4cf03 req-e0f23b2f-612b-4fef-8742-56b2a7fa29ee service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Updating instance_info_cache with network_info: [{"id": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "address": "fa:16:3e:d6:ab:57", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapefa28b28-67", "ovs_interfaceid": "efa28b28-671b-4eb3-8c4f-14f59d5ce0ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-536e9eee-cae0-4336-be2b-58558dd4cf03 req-e0f23b2f-612b-4fef-8742-56b2a7fa29ee service nova] Releasing lock "refresh_cache-470352e3-0bab-4cdc-a6a9-7539b5fd1553" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:13:07 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Took 0.50 seconds to deallocate network for instance.
Nov 13 21:13:07 user nova-compute[75239]: DEBUG nova.compute.manager [req-b6b3c455-0d9a-4678-b8aa-d4cbefd87e43 req-c9a9cd7c-058e-4de0-80bf-019409aa1cf3 service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received event network-vif-deleted-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-9f75450f-104e-4e0e-bc1d-b3b7680ef3a9 req-0ea8486b-a127-4463-b5c2-21de510a603c service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received event network-vif-plugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9f75450f-104e-4e0e-bc1d-b3b7680ef3a9 req-0ea8486b-a127-4463-b5c2-21de510a603c service nova] Acquiring lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9f75450f-104e-4e0e-bc1d-b3b7680ef3a9 req-0ea8486b-a127-4463-b5c2-21de510a603c service nova] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9f75450f-104e-4e0e-bc1d-b3b7680ef3a9 req-0ea8486b-a127-4463-b5c2-21de510a603c service nova] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG nova.compute.manager [req-9f75450f-104e-4e0e-bc1d-b3b7680ef3a9 req-0ea8486b-a127-4463-b5c2-21de510a603c service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] No waiting events found dispatching network-vif-plugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:13:08 user nova-compute[75239]: WARNING nova.compute.manager [req-9f75450f-104e-4e0e-bc1d-b3b7680ef3a9 req-0ea8486b-a127-4463-b5c2-21de510a603c service nova] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Received unexpected event network-vif-plugged-efa28b28-671b-4eb3-8c4f-14f59d5ce0ab for instance with vm_state active and task_state deleting.
Nov 13 21:13:08 user nova-compute[75239]: INFO nova.compute.manager [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 470352e3-0bab-4cdc-a6a9-7539b5fd1553] Took 0.78 seconds to detach 1 volumes for instance.
Nov 13 21:13:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:13:08 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Deleted allocations for instance 470352e3-0bab-4cdc-a6a9-7539b5fd1553
Nov 13 21:13:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:08 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a117413d-ce31-4d9a-9895-bf53281b1233 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "470352e3-0bab-4cdc-a6a9-7539b5fd1553" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.779s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:13:09 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:11 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:16 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:13:21 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:13:25 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:26 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:13:31 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:13:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:13:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:13:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:13:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:13:36 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:13:46 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:51 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:55 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:55 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:13:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:13:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:13:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:13:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:13:56 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 21:13:57 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:13:57 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9045MB free_disk=24.94561767578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 809806ec-8a14-4888-a43f-35e0e07cefd0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 21:13:57 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 21:13:58 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 21:13:58 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:13:58 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:13:58 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:13:58 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-d87fbd76-8649-43f5-93b9-e50ffaf8dd63 req-c4dc60d3-a737-4a0d-9527-e633dcaf8b15 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received event network-changed-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-d87fbd76-8649-43f5-93b9-e50ffaf8dd63 req-c4dc60d3-a737-4a0d-9527-e633dcaf8b15 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Refreshing instance network info cache due to event network-changed-c6455c55-d536-4edc-a474-84d80eb668bb. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d87fbd76-8649-43f5-93b9-e50ffaf8dd63 req-c4dc60d3-a737-4a0d-9527-e633dcaf8b15 service nova] Acquiring lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d87fbd76-8649-43f5-93b9-e50ffaf8dd63 req-c4dc60d3-a737-4a0d-9527-e633dcaf8b15 service nova] Acquired lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG nova.network.neutron [req-d87fbd76-8649-43f5-93b9-e50ffaf8dd63 req-c4dc60d3-a737-4a0d-9527-e633dcaf8b15 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Refreshing network info cache for port c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "809806ec-8a14-4888-a43f-35e0e07cefd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:13:59 user nova-compute[75239]: INFO nova.compute.manager [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Terminating instance
Nov 13 21:13:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-fd7e5547-50fe-42a4-9e1d-50567ff995ac req-48f07018-a2cb-4644-b600-2302400b1c02 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received event network-vif-unplugged-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fd7e5547-50fe-42a4-9e1d-50567ff995ac req-48f07018-a2cb-4644-b600-2302400b1c02 service nova] Acquiring lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fd7e5547-50fe-42a4-9e1d-50567ff995ac req-48f07018-a2cb-4644-b600-2302400b1c02 service nova] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-fd7e5547-50fe-42a4-9e1d-50567ff995ac req-48f07018-a2cb-4644-b600-2302400b1c02 service nova] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-fd7e5547-50fe-42a4-9e1d-50567ff995ac req-48f07018-a2cb-4644-b600-2302400b1c02 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] No waiting events found dispatching network-vif-unplugged-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:13:59 user nova-compute[75239]: DEBUG nova.compute.manager [req-fd7e5547-50fe-42a4-9e1d-50567ff995ac req-48f07018-a2cb-4644-b600-2302400b1c02 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received event network-vif-unplugged-c6455c55-d536-4edc-a474-84d80eb668bb for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.network.neutron [req-d87fbd76-8649-43f5-93b9-e50ffaf8dd63 req-c4dc60d3-a737-4a0d-9527-e633dcaf8b15 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updated VIF entry in instance network info cache for port c6455c55-d536-4edc-a474-84d80eb668bb. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.network.neutron [req-d87fbd76-8649-43f5-93b9-e50ffaf8dd63 req-c4dc60d3-a737-4a0d-9527-e633dcaf8b15 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating instance_info_cache with network_info: [{"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-d87fbd76-8649-43f5-93b9-e50ffaf8dd63 req-c4dc60d3-a737-4a0d-9527-e633dcaf8b15 service nova] Releasing lock "refresh_cache-809806ec-8a14-4888-a43f-35e0e07cefd0" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:14:00 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Instance destroyed successfully.
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.objects.instance [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lazy-loading 'resources' on Instance uuid 809806ec-8a14-4888-a43f-35e0e07cefd0 {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:09:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-802802704',display_name='tempest-TestVolumeBootPattern-server-802802704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-802802704',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInC+sZCaKDSI50O8C8gGNwh8J8RgdnkdYIEwC/z0KDx2uN6GFrm5Akq9jizFgdrHKLHCMpaEbLx/BZo3JjgjKWbrE7hgTFDncZBWFRtdULHtjLI6ELBo5Oz3EJMja6xow==',key_name='tempest-TestVolumeBootPattern-1106875438',keypairs=<?>,launch_index=0,launched_at=2023-11-13T21:09:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fbc5530ef3c040dd82883043dabc4c7d',ramdisk_id='',reservation_id='r-d6laitfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1828724263',owner_user_name='tempest-TestVolumeBootPattern-1828724263-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T21:09:27Z,user_data=None,user_id='7e1458f29bb94b0abd4b75ac943fb531',uuid=809806ec-8a14-4888-a43f-35e0e07cefd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converting VIF {"id": "c6455c55-d536-4edc-a474-84d80eb668bb", "address": "fa:16:3e:ff:af:bf", "network": {"id": "8190b3da-0152-4ccc-8365-335d27485f3b", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324483386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fbc5530ef3c040dd82883043dabc4c7d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6455c55-d5", "ovs_interfaceid": "c6455c55-d536-4edc-a474-84d80eb668bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:af:bf,bridge_name='br-int',has_traffic_filtering=True,id=c6455c55-d536-4edc-a474-84d80eb668bb,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6455c55-d5') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_vif [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:af:bf,bridge_name='br-int',has_traffic_filtering=True,id=c6455c55-d536-4edc-a474-84d80eb668bb,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6455c55-d5') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6455c55-d5, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38e68421-52ac-47a8-9661-75ee7e87057a) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:00 user nova-compute[75239]: INFO os_vif [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:af:bf,bridge_name='br-int',has_traffic_filtering=True,id=c6455c55-d536-4edc-a474-84d80eb668bb,network=Network(8190b3da-0152-4ccc-8365-335d27485f3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6455c55-d5')
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tpHCQvNT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:14:00 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ea2adb-3612-4372-aa1d-7fab83ada3e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:14:00 user nova-compute[75239]: No targets found.
Nov 13 21:14:00 user nova-compute[75239]: iSNS:
Nov 13 21:14:00 user nova-compute[75239]: No targets found.
Nov 13 21:14:00 user nova-compute[75239]: STATIC:
Nov 13 21:14:00 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675
Nov 13 21:14:00 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:14:00 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:14:00 user nova-compute[75239]: FIRMWARE:
Nov 13 21:14:00 user nova-compute[75239]: No targets found.
Nov 13 21:14:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:14:00 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:14:00 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a962a7-cf37-4ab9-97d0-1c4cf458186a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5159d57-27aa-4329-9921-a337eb168bc2]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:14:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 (non-flash)
Nov 13 21:14:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d6025a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c328603b-6556-4d43-9d4e-b05ba8c54b82]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3376a65-2f0e-4fec-8680-0f8797751683]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e285535-6303-4ff2-8bbb-ab972f32d5b4]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f43430-a206-4a96-88da-567bd0ba385f]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO258d61b3-7efb4fe060c34be6', '/dev/disk/by-id/scsi-23765666234666530', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_258d61b3') {{(pid=86402) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67175b7-9bd4-4b85-9992-70c8322b7676]: (4, None) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[044cbb0a-6f34-4c1d-a838-bf41821eadae]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ead872-3fc9-4bde-a102-a2f295614d19]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260]
Nov 13 21:14:00 user nova-compute[75239]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675, portal: 172.16.0.220,3260] successful.
Nov 13 21:14:00 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f222e2fb-0c96-481d-a54a-0f3a10f32675 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[300bffe0-7f55-46c4-a0e9-e447b30429cd]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] <== disconnect_volume: return (283ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:14:00 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Deleting instance files /opt/stack/data/nova/instances/809806ec-8a14-4888-a43f-35e0e07cefd0_del
Nov 13 21:14:00 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Deletion of /opt/stack/data/nova/instances/809806ec-8a14-4888-a43f-35e0e07cefd0_del complete
Nov 13 21:14:00 user nova-compute[75239]: INFO nova.compute.manager [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 13 21:14:00 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:14:00 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:14:01 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:14:01 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Took 0.43 seconds to deallocate network for instance.
Nov 13 21:14:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-e6be7c71-0b0d-4578-8511-ecb77071e595 req-bf81a5b8-d116-46e4-a468-780cf29de736 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received event network-vif-deleted-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:14:01 user nova-compute[75239]: INFO nova.compute.manager [req-e6be7c71-0b0d-4578-8511-ecb77071e595 req-bf81a5b8-d116-46e4-a468-780cf29de736 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Neutron deleted interface c6455c55-d536-4edc-a474-84d80eb668bb; detaching it from the instance and deleting it from the info cache
Nov 13 21:14:01 user nova-compute[75239]: DEBUG nova.network.neutron [req-e6be7c71-0b0d-4578-8511-ecb77071e595 req-bf81a5b8-d116-46e4-a468-780cf29de736 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:14:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-e6be7c71-0b0d-4578-8511-ecb77071e595 req-bf81a5b8-d116-46e4-a468-780cf29de736 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Detach interface failed, port_id=c6455c55-d536-4edc-a474-84d80eb668bb, reason: Instance 809806ec-8a14-4888-a43f-35e0e07cefd0 could not be found. {{(pid=75239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 21:14:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-9f0a3fe3-9f1d-4321-9175-c97718fb6df5 req-0d98967f-c94c-4e3e-8be3-f9bfe05a5145 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received event network-vif-plugged-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:14:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9f0a3fe3-9f1d-4321-9175-c97718fb6df5 req-0d98967f-c94c-4e3e-8be3-f9bfe05a5145 service nova] Acquiring lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:14:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9f0a3fe3-9f1d-4321-9175-c97718fb6df5 req-0d98967f-c94c-4e3e-8be3-f9bfe05a5145 service nova] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:14:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9f0a3fe3-9f1d-4321-9175-c97718fb6df5 req-0d98967f-c94c-4e3e-8be3-f9bfe05a5145 service nova] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:14:01 user nova-compute[75239]: DEBUG nova.compute.manager [req-9f0a3fe3-9f1d-4321-9175-c97718fb6df5 req-0d98967f-c94c-4e3e-8be3-f9bfe05a5145 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] No waiting events found dispatching network-vif-plugged-c6455c55-d536-4edc-a474-84d80eb668bb {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:14:01 user nova-compute[75239]: WARNING nova.compute.manager [req-9f0a3fe3-9f1d-4321-9175-c97718fb6df5 req-0d98967f-c94c-4e3e-8be3-f9bfe05a5145 service nova] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Received unexpected event network-vif-plugged-c6455c55-d536-4edc-a474-84d80eb668bb for instance with vm_state active and task_state deleting.
Nov 13 21:14:01 user nova-compute[75239]: INFO nova.compute.manager [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] [instance: 809806ec-8a14-4888-a43f-35e0e07cefd0] Took 0.72 seconds to detach 1 volumes for instance.
Nov 13 21:14:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:14:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:14:02 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:14:02 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:14:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:14:02 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Deleted allocations for instance 809806ec-8a14-4888-a43f-35e0e07cefd0
Nov 13 21:14:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-0324e9ea-e891-4dd8-a23e-e2ce970ccff7 tempest-TestVolumeBootPattern-1828724263 tempest-TestVolumeBootPattern-1828724263-project-member] Lock "809806ec-8a14-4888-a43f-35e0e07cefd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.682s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:14:03 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:03 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:03 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:14:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:14:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 21:14:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:14:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:14:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:14:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:14:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:11 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:11 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:11 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 21:14:15 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:14:17 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 21:14:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 21:14:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:14:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:14:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:14:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:14:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:14:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:14:45 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:50 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:54 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:55 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:56 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:56 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:14:57 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:14:57 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:14:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9174MB free_disk=24.944313049316406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:14:57 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:15:00 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:02 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:03 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:15:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:15:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:15:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:15:05 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:15:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:15:08 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 21:15:10 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:13 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:15:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:15:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:15:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:15:15 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:20 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:24 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:25 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:26 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:30 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:34 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:35 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:15:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:15:39 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Starting instance... {{(pid=75239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 21:15:40 user nova-compute[75239]: INFO nova.compute.claims [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Claim successful on node user
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Start building networks asynchronously for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Allocating IP information in the background. {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] allocate_for_instance() {{(pid=75239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 21:15:40 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Start building block device mappings for instance. {{(pid=75239) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.policy [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4106d86f6848433d939b67c169a8a43f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfea5dd14e547abb7cbc71a88c73a2c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75239) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Start spawning the instance on the hypervisor. {{(pid=75239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Creating instance directory {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 21:15:40 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Creating image(s)
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "/opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "/opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "/opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.174s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.194s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:15:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk 1073741824 {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79,backing_fmt=raw /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk 1073741824" returned: 0 in 0.047s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "5c3e374f9bb814afe5429b7414b85c855bea5a79" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Successfully created port: 96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c3e374f9bb814afe5429b7414b85c855bea5a79 --force-share --output=json" returned: 0 in 0.214s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk. size=1073741824 {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.virt.disk.api [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Cannot resize image /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk to a smaller size. {{(pid=75239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Created local disks {{(pid=75239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Ensure instance console log exists: /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/console.log {{(pid=75239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Successfully updated port: 96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquired lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Building network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-c01b8ce5-3e62-4cb4-b78e-cdd4f4b0cea7 req-3f91434a-b65a-49f1-8a19-7827f3a87447 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received event network-changed-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.compute.manager [req-c01b8ce5-3e62-4cb4-b78e-cdd4f4b0cea7 req-3f91434a-b65a-49f1-8a19-7827f3a87447 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Refreshing instance network info cache due to event network-changed-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c01b8ce5-3e62-4cb4-b78e-cdd4f4b0cea7 req-3f91434a-b65a-49f1-8a19-7827f3a87447 service nova] Acquiring lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:15:41 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Instance cache missing network info. {{(pid=75239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.network.neutron [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Releasing lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Instance network_info: |[{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c01b8ce5-3e62-4cb4-b78e-cdd4f4b0cea7 req-3f91434a-b65a-49f1-8a19-7827f3a87447 service nova] Acquired lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-c01b8ce5-3e62-4cb4-b78e-cdd4f4b0cea7 req-3f91434a-b65a-49f1-8a19-7827f3a87447 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Refreshing network info cache for port 96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Start _get_guest_xml network_info=[{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'guest_format': None, 'image_id': '800ade11-c0e2-452c-9cf5-70051593ac8f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 21:15:42 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:15:42 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] CPU controller missing on host. {{(pid=75239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.host [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] CPU controller found on host. {{(pid=75239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T20:28:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T20:28:50Z,direct_url=<?>,disk_format='qcow2',id=800ade11-c0e2-452c-9cf5-70051593ac8f,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='d921943282b34576a1b595bddf0e78cb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T20:28:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Flavor limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Image limits 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Flavor pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Image pref 0:0:0 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Got 1 possible topologies {{(pid=75239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.hardware [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-360554333',display_name='tempest-SnapshotDataIntegrityTests-server-360554333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-360554333',id=53,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKUdHgSRij2/T1CSZG63TWY2p2ozdE8vtgvjn/mq7WtjcnrBRpU2cMUMYbhg5SOoQjvk9F0BLFoEOeXHrTmygY+GWxRZLaTq8JG/CvXc5ANM48yZ868hpUh+8UrktgTiw==',key_name='tempest-keypair-759221340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbfea5dd14e547abb7cbc71a88c73a2c',ramdisk_id='',reservation_id='r-c74ys1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1805382459',owner_user_name='tempest-SnapshotDataIntegrityTests-1805382459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4106d86f6848433d939b67c169a8a43f',uuid=07934dee-2623-4962-ac25-cab60b8b0e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Converting VIF {"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b3:21,bridge_name='br-int',has_traffic_filtering=True,id=96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca,network=Network(aab9279a-ea88-4764-a960-e947db94748d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96db4cf0-5b') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.objects.instance [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'pci_devices' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] End _get_guest_xml xml=<domain type="kvm">
Nov 13 21:15:42 user nova-compute[75239]:   <uuid>07934dee-2623-4962-ac25-cab60b8b0e8a</uuid>
Nov 13 21:15:42 user nova-compute[75239]:   <name>instance-00000035</name>
Nov 13 21:15:42 user nova-compute[75239]:   <memory>524288</memory>
Nov 13 21:15:42 user nova-compute[75239]:   <vcpu>1</vcpu>
Nov 13 21:15:42 user nova-compute[75239]:   <metadata>
Nov 13 21:15:42 user nova-compute[75239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 21:15:42 user nova-compute[75239]:       <nova:package version="0.0.0"/>
Nov 13 21:15:42 user nova-compute[75239]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-360554333</nova:name>
Nov 13 21:15:42 user nova-compute[75239]:       <nova:creationTime>2023-11-13 21:15:42</nova:creationTime>
Nov 13 21:15:42 user nova-compute[75239]:       <nova:flavor name="m1.tiny">
Nov 13 21:15:42 user nova-compute[75239]:         <nova:memory>512</nova:memory>
Nov 13 21:15:42 user nova-compute[75239]:         <nova:disk>1</nova:disk>
Nov 13 21:15:42 user nova-compute[75239]:         <nova:swap>0</nova:swap>
Nov 13 21:15:42 user nova-compute[75239]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 21:15:42 user nova-compute[75239]:         <nova:vcpus>1</nova:vcpus>
Nov 13 21:15:42 user nova-compute[75239]:       </nova:flavor>
Nov 13 21:15:42 user nova-compute[75239]:       <nova:owner>
Nov 13 21:15:42 user nova-compute[75239]:         <nova:user uuid="4106d86f6848433d939b67c169a8a43f">tempest-SnapshotDataIntegrityTests-1805382459-project-member</nova:user>
Nov 13 21:15:42 user nova-compute[75239]:         <nova:project uuid="cbfea5dd14e547abb7cbc71a88c73a2c">tempest-SnapshotDataIntegrityTests-1805382459</nova:project>
Nov 13 21:15:42 user nova-compute[75239]:       </nova:owner>
Nov 13 21:15:42 user nova-compute[75239]:       <nova:root type="image" uuid="800ade11-c0e2-452c-9cf5-70051593ac8f"/>
Nov 13 21:15:42 user nova-compute[75239]:       <nova:ports>
Nov 13 21:15:42 user nova-compute[75239]:         <nova:port uuid="96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca">
Nov 13 21:15:42 user nova-compute[75239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 21:15:42 user nova-compute[75239]:         </nova:port>
Nov 13 21:15:42 user nova-compute[75239]:       </nova:ports>
Nov 13 21:15:42 user nova-compute[75239]:     </nova:instance>
Nov 13 21:15:42 user nova-compute[75239]:   </metadata>
Nov 13 21:15:42 user nova-compute[75239]:   <sysinfo type="smbios">
Nov 13 21:15:42 user nova-compute[75239]:     <system>
Nov 13 21:15:42 user nova-compute[75239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 21:15:42 user nova-compute[75239]:       <entry name="product">OpenStack Nova</entry>
Nov 13 21:15:42 user nova-compute[75239]:       <entry name="version">0.0.0</entry>
Nov 13 21:15:42 user nova-compute[75239]:       <entry name="serial">07934dee-2623-4962-ac25-cab60b8b0e8a</entry>
Nov 13 21:15:42 user nova-compute[75239]:       <entry name="uuid">07934dee-2623-4962-ac25-cab60b8b0e8a</entry>
Nov 13 21:15:42 user nova-compute[75239]:       <entry name="family">Virtual Machine</entry>
Nov 13 21:15:42 user nova-compute[75239]:     </system>
Nov 13 21:15:42 user nova-compute[75239]:   </sysinfo>
Nov 13 21:15:42 user nova-compute[75239]:   <os>
Nov 13 21:15:42 user nova-compute[75239]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 21:15:42 user nova-compute[75239]:     <boot dev="hd"/>
Nov 13 21:15:42 user nova-compute[75239]:     <smbios mode="sysinfo"/>
Nov 13 21:15:42 user nova-compute[75239]:   </os>
Nov 13 21:15:42 user nova-compute[75239]:   <features>
Nov 13 21:15:42 user nova-compute[75239]:     <acpi/>
Nov 13 21:15:42 user nova-compute[75239]:     <apic/>
Nov 13 21:15:42 user nova-compute[75239]:     <vmcoreinfo/>
Nov 13 21:15:42 user nova-compute[75239]:   </features>
Nov 13 21:15:42 user nova-compute[75239]:   <clock offset="utc">
Nov 13 21:15:42 user nova-compute[75239]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 21:15:42 user nova-compute[75239]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 21:15:42 user nova-compute[75239]:     <timer name="hpet" present="no"/>
Nov 13 21:15:42 user nova-compute[75239]:   </clock>
Nov 13 21:15:42 user nova-compute[75239]:   <cpu mode="custom" match="exact">
Nov 13 21:15:42 user nova-compute[75239]:     <model>Nehalem</model>
Nov 13 21:15:42 user nova-compute[75239]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 21:15:42 user nova-compute[75239]:   </cpu>
Nov 13 21:15:42 user nova-compute[75239]:   <devices>
Nov 13 21:15:42 user nova-compute[75239]:     <disk type="file" device="disk">
Nov 13 21:15:42 user nova-compute[75239]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 21:15:42 user nova-compute[75239]:       <source file="/opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk"/>
Nov 13 21:15:42 user nova-compute[75239]:       <target dev="vda" bus="virtio"/>
Nov 13 21:15:42 user nova-compute[75239]:     </disk>
Nov 13 21:15:42 user nova-compute[75239]:     <interface type="ethernet">
Nov 13 21:15:42 user nova-compute[75239]:       <mac address="fa:16:3e:2a:b3:21"/>
Nov 13 21:15:42 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:15:42 user nova-compute[75239]:       <mtu size="1442"/>
Nov 13 21:15:42 user nova-compute[75239]:       <target dev="tap96db4cf0-5b"/>
Nov 13 21:15:42 user nova-compute[75239]:     </interface>
Nov 13 21:15:42 user nova-compute[75239]:     <serial type="pty">
Nov 13 21:15:42 user nova-compute[75239]:       <log file="/opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/console.log" append="off"/>
Nov 13 21:15:42 user nova-compute[75239]:     </serial>
Nov 13 21:15:42 user nova-compute[75239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 21:15:42 user nova-compute[75239]:     <video>
Nov 13 21:15:42 user nova-compute[75239]:       <model type="virtio"/>
Nov 13 21:15:42 user nova-compute[75239]:     </video>
Nov 13 21:15:42 user nova-compute[75239]:     <rng model="virtio">
Nov 13 21:15:42 user nova-compute[75239]:       <backend model="random">/dev/urandom</backend>
Nov 13 21:15:42 user nova-compute[75239]:     </rng>
Nov 13 21:15:42 user nova-compute[75239]:     <controller type="usb" index="0" model="none"/>
Nov 13 21:15:42 user nova-compute[75239]:     <memballoon model="virtio">
Nov 13 21:15:42 user nova-compute[75239]:       <stats period="10"/>
Nov 13 21:15:42 user nova-compute[75239]:     </memballoon>
Nov 13 21:15:42 user nova-compute[75239]:   </devices>
Nov 13 21:15:42 user nova-compute[75239]: </domain>
Nov 13 21:15:42 user nova-compute[75239]:  {{(pid=75239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-360554333',display_name='tempest-SnapshotDataIntegrityTests-server-360554333',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-360554333',id=53,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKUdHgSRij2/T1CSZG63TWY2p2ozdE8vtgvjn/mq7WtjcnrBRpU2cMUMYbhg5SOoQjvk9F0BLFoEOeXHrTmygY+GWxRZLaTq8JG/CvXc5ANM48yZ868hpUh+8UrktgTiw==',key_name='tempest-keypair-759221340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbfea5dd14e547abb7cbc71a88c73a2c',ramdisk_id='',reservation_id='r-c74ys1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1805382459',owner_user_name='tempest-SnapshotDataIntegrityTests-1805382459-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T21:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4106d86f6848433d939b67c169a8a43f',uuid=07934dee-2623-4962-ac25-cab60b8b0e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Converting VIF {"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b3:21,bridge_name='br-int',has_traffic_filtering=True,id=96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca,network=Network(aab9279a-ea88-4764-a960-e947db94748d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96db4cf0-5b') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG os_vif [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b3:21,bridge_name='br-int',has_traffic_filtering=True,id=96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca,network=Network(aab9279a-ea88-4764-a960-e947db94748d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96db4cf0-5b') {{(pid=75239) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18437835-3883-5733-ba5d-d9504bde4bf3', '_type': 'linux-noop'}}, row=False) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96db4cf0-5b, may_exist=True, interface_attrs={}) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96db4cf0-5b, col_values=(('qos', UUID('1d92f67c-39b5-407f-bba1-63ce55ef25a1')),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96db4cf0-5b, col_values=(('external_ids', {'iface-id': '96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:b3:21', 'vm-uuid': '07934dee-2623-4962-ac25-cab60b8b0e8a'}),), if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:42 user nova-compute[75239]: INFO os_vif [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:b3:21,bridge_name='br-int',has_traffic_filtering=True,id=96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca,network=Network(aab9279a-ea88-4764-a960-e947db94748d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96db4cf0-5b')
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No VIF found with MAC fa:16:3e:2a:b3:21, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-c01b8ce5-3e62-4cb4-b78e-cdd4f4b0cea7 req-3f91434a-b65a-49f1-8a19-7827f3a87447 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updated VIF entry in instance network info cache for port 96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG nova.network.neutron [req-c01b8ce5-3e62-4cb4-b78e-cdd4f4b0cea7 req-3f91434a-b65a-49f1-8a19-7827f3a87447 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:15:42 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-c01b8ce5-3e62-4cb4-b78e-cdd4f4b0cea7 req-3f91434a-b65a-49f1-8a19-7827f3a87447 service nova] Releasing lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:15:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-426df480-fe00-41ae-8cd7-dcf0421d55b7 req-2cfbbe57-21f5-43fe-8cd5-b23b5579137c service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received event network-vif-plugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:15:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-426df480-fe00-41ae-8cd7-dcf0421d55b7 req-2cfbbe57-21f5-43fe-8cd5-b23b5579137c service nova] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:15:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-426df480-fe00-41ae-8cd7-dcf0421d55b7 req-2cfbbe57-21f5-43fe-8cd5-b23b5579137c service nova] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:15:44 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-426df480-fe00-41ae-8cd7-dcf0421d55b7 req-2cfbbe57-21f5-43fe-8cd5-b23b5579137c service nova] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:15:44 user nova-compute[75239]: DEBUG nova.compute.manager [req-426df480-fe00-41ae-8cd7-dcf0421d55b7 req-2cfbbe57-21f5-43fe-8cd5-b23b5579137c service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] No waiting events found dispatching network-vif-plugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:15:44 user nova-compute[75239]: WARNING nova.compute.manager [req-426df480-fe00-41ae-8cd7-dcf0421d55b7 req-2cfbbe57-21f5-43fe-8cd5-b23b5579137c service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received unexpected event network-vif-plugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca for instance with vm_state building and task_state spawning.
Nov 13 21:15:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Instance event wait completed in 0 seconds for  {{(pid=75239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Guest created on hypervisor {{(pid=75239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 21:15:46 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Instance spawned successfully.
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Found default for hw_cdrom_bus of ide {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Found default for hw_disk_bus of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Found default for hw_input_bus of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Found default for hw_pointer_model of None {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Found default for hw_video_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Found default for hw_vif_model of virtio {{(pid=75239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 21:15:46 user nova-compute[75239]: INFO nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Checking state {{(pid=75239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 21:15:46 user nova-compute[75239]: INFO nova.compute.manager [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Took 6.48 seconds to build instance.
Nov 13 21:15:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-bf055166-a114-440d-8f77-a1e5606a20f6 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.601s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.compute.manager [req-9dc196a9-51f6-4462-95c0-73bfb361a81b req-f446890d-b5d4-4d2b-9496-00ab813f96a8 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received event network-vif-plugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9dc196a9-51f6-4462-95c0-73bfb361a81b req-f446890d-b5d4-4d2b-9496-00ab813f96a8 service nova] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9dc196a9-51f6-4462-95c0-73bfb361a81b req-f446890d-b5d4-4d2b-9496-00ab813f96a8 service nova] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-9dc196a9-51f6-4462-95c0-73bfb361a81b req-f446890d-b5d4-4d2b-9496-00ab813f96a8 service nova] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:15:46 user nova-compute[75239]: DEBUG nova.compute.manager [req-9dc196a9-51f6-4462-95c0-73bfb361a81b req-f446890d-b5d4-4d2b-9496-00ab813f96a8 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] No waiting events found dispatching network-vif-plugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:15:46 user nova-compute[75239]: WARNING nova.compute.manager [req-9dc196a9-51f6-4462-95c0-73bfb361a81b req-f446890d-b5d4-4d2b-9496-00ab813f96a8 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received unexpected event network-vif-plugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca for instance with vm_state active and task_state None.
Nov 13 21:15:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:15:58 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:58 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:15:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:15:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:15:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:15:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:15:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:15:59 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:15:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:15:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:15:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:15:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:16:00 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:16:00 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:16:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=24.928245544433594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:16:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:16:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:16:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 07934dee-2623-4962-ac25-cab60b8b0e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:16:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:16:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:16:00 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:16:00 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:16:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:16:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:16:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:16:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:16:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:16:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:16:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:16:09 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:16:10 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:16:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:15 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:16:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:16:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:16:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:16:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:16:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:16:59 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:00 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:17:00 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:17:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9038MB free_disk=24.89963150024414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:17:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:17:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:17:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 07934dee-2623-4962-ac25-cab60b8b0e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:17:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:17:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:17:00 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:17:00 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:17:00 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:17:00 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:17:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:17:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:17:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:17:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:17:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:17:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:17:11 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:17:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:12 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:17:15 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:17:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:17:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:28 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:17:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-a74236df-172c-4657-919b-88f972673b56 req-ec897870-a2de-4727-95e8-9cb821f41078 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received event network-changed-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:17:30 user nova-compute[75239]: DEBUG nova.compute.manager [req-a74236df-172c-4657-919b-88f972673b56 req-ec897870-a2de-4727-95e8-9cb821f41078 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Refreshing instance network info cache due to event network-changed-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca. {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 21:17:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a74236df-172c-4657-919b-88f972673b56 req-ec897870-a2de-4727-95e8-9cb821f41078 service nova] Acquiring lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:17:30 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a74236df-172c-4657-919b-88f972673b56 req-ec897870-a2de-4727-95e8-9cb821f41078 service nova] Acquired lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:17:30 user nova-compute[75239]: DEBUG nova.network.neutron [req-a74236df-172c-4657-919b-88f972673b56 req-ec897870-a2de-4727-95e8-9cb821f41078 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Refreshing network info cache for port 96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 21:17:31 user nova-compute[75239]: DEBUG nova.network.neutron [req-a74236df-172c-4657-919b-88f972673b56 req-ec897870-a2de-4727-95e8-9cb821f41078 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updated VIF entry in instance network info cache for port 96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca. {{(pid=75239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 21:17:31 user nova-compute[75239]: DEBUG nova.network.neutron [req-a74236df-172c-4657-919b-88f972673b56 req-ec897870-a2de-4727-95e8-9cb821f41078 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:17:31 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-a74236df-172c-4657-919b-88f972673b56 req-ec897870-a2de-4727-95e8-9cb821f41078 service nova] Releasing lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:17:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:17:34 user nova-compute[75239]: INFO nova.compute.manager [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attaching volume caaadb47-6971-4287-a235-21268163dc62 to /dev/vdb
Nov 13 21:17:34 user nova-compute[75239]: DEBUG os_brick.utils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7c8bed-49ac-424c-a47b-f311311df0ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8abb202-3706-49ed-8601-54b6cafd366b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[776578b5-4b94-4331-b707-23f384d6a141]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a10de0-29ab-4a8c-aa5c-f34399a94af5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:17:34 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:17:34 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b8ff2a-7988-4cee-8749-2141cd22d580]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG os_brick.utils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:17:34 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating existing volume attachment record: dc5701a9-8183-46d9-a3ff-42b1c81c98a8 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:17:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VISjbMis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:17:38 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:17:38 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:17:38 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[194393ff-1bfb-4e36-926f-2031a082699a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:17:38 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f461f6a1-285b-4fd1-b868-009773aa794d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62] added
Nov 13 21:17:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e743f6-7ed2-471e-bdb1-a399be291527]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad906251-19f7-491a-a7de-b4c5bfece5f2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VISjbMis {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VISjbMis" returned: 0 in 0.027s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9e097a-ffea-4848-ac07-1775e52caa4d]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VISjbMis'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd49b004-2fda-4d55-bcb0-73c3068a6238]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[356beacb-54d8-4a6e-8830-02e08a9cb65b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:17:38 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:17:38 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:17:38 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 21:17:38 user nova-compute[75239]: 
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a052001-6833-4c65-8a0e-1915bb8f89df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62, portal: 172.16.0.220,3260]
Nov 13 21:17:38 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62, portal: 172.16.0.220,3260] successful.
Nov 13 21:17:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2640af4e-eac0-415c-8920-a52c1a8a5ec1]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6285ca35-85c6-41c9-9e81-dfa6348287b8]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 (non-flash)
Nov 13 21:17:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 (non-flash)
Nov 13 21:17:38 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[896d3982-3041-41a8-b5b2-e057c672deaf]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:17:38 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:17:39 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:17:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VISjbMis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:17:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:17:39 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26162626362353239', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:17:39 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162626362353239', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:17:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:17:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 21:17:40 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:17:40 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:17:40 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:17:40 user nova-compute[75239]:   <serial>caaadb47-6971-4287-a235-21268163dc62</serial>
Nov 13 21:17:40 user nova-compute[75239]: </disk>
Nov 13 21:17:40 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 21:17:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:17:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:17:40 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No VIF found with MAC fa:16:3e:2a:b3:21, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:17:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-9e5564d7-f3b9-47a5-936d-608e841c557a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.354s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:17:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:17:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:17:47 user nova-compute[75239]: INFO nova.compute.manager [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Detaching volume caaadb47-6971-4287-a235-21268163dc62
Nov 13 21:17:48 user nova-compute[75239]: INFO nova.virt.block_device [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attempting to driver detach volume caaadb47-6971-4287-a235-21268163dc62 from mountpoint /dev/vdb
Nov 13 21:17:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Attempting to detach device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 21:17:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:17:48 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:17:48 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:17:48 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:17:48 user nova-compute[75239]:   <serial>caaadb47-6971-4287-a235-21268163dc62</serial>
Nov 13 21:17:48 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:17:48 user nova-compute[75239]: </disk>
Nov 13 21:17:48 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:17:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully detached device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the persistent domain config.
Nov 13 21:17:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 21:17:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:17:48 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:17:48 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:17:48 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:17:48 user nova-compute[75239]:   <serial>caaadb47-6971-4287-a235-21268163dc62</serial>
Nov 13 21:17:48 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:17:48 user nova-compute[75239]: </disk>
Nov 13 21:17:48 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:17:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 21:17:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:17:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:00 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:18:00 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:18:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:18:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:18:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:18:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:18:01 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:18:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:02 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:18:02 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:18:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.89838409423828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 07934dee-2623-4962-ac25-cab60b8b0e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:18:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:18:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:18:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:18:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:18:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:18:08 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07934dee-2623-4962-ac25-cab60b8b0e8a is timed out.
Nov 13 21:18:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully detached device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the live domain config.
Nov 13 21:18:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VISjbMis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:18:08 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c14858-bc03-4585-9387-a355696c1b4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:18:08 user nova-compute[75239]: No targets found.
Nov 13 21:18:08 user nova-compute[75239]: iSNS:
Nov 13 21:18:08 user nova-compute[75239]: No targets found.
Nov 13 21:18:08 user nova-compute[75239]: STATIC:
Nov 13 21:18:08 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62
Nov 13 21:18:08 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:18:08 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:18:08 user nova-compute[75239]: FIRMWARE:
Nov 13 21:18:08 user nova-compute[75239]: No targets found.
Nov 13 21:18:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:18:08 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:18:08 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7854e4-efef-46ba-9e8e-dfd1557360a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[58165cec-4531-4c72-8cc1-79a2475e8c54]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 (non-flash)
Nov 13 21:18:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 (non-flash)
Nov 13 21:18:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d60590f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccc3b35-55a9-4950-a42e-acf347662780]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a84318-9515-4553-a71d-d7702a303ce4]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40718ce-af1f-4da4-a006-d4892d1ccad7]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1086fd4b-d7d6-4a08-b436-79316397c6df]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc57a1a-015a-48ff-aa38-98da15c55db0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd0ecb2-135e-417d-ad0f-207e43c6c441]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62, portal: 172.16.0.220,3260]
Nov 13 21:18:08 user nova-compute[75239]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62, portal: 172.16.0.220,3260] successful.
Nov 13 21:18:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caaadb47-6971-4287-a235-21268163dc62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b781e824-f582-4375-ae14-0fd16b3f6297]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== disconnect_volume: return (272ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:18:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:18:09 user nova-compute[75239]: DEBUG nova.objects.instance [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:18:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-28e828f8-a869-4366-926e-88dda0334d3a tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.546s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:18:12 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:18:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:18:13 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:18:15 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:18:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:18:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:18:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:18:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:18:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:18:39 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:18:39 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:18:40 user nova-compute[75239]: INFO nova.compute.manager [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attaching volume 5b7ed67f-1747-4fa1-a950-c922247cca91 to /dev/vdb
Nov 13 21:18:40 user nova-compute[75239]: DEBUG os_brick.utils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d54e0b-6d24-411e-b88f-613f60f48a90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab782b0b-c20b-480a-bf43-3c70c717ad62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b6382d-5fa5-4ced-bb62-3132a1c690ab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccdc365-ee5f-4aed-9f99-9bab8a1c79f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:18:40 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:18:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8489dd9f-abdc-4333-9e91-c7f02d765b7d]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG os_brick.utils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:18:40 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating existing volume attachment record: d5da8d6a-8956-44f5-94b2-eca9f27b2a33 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:18:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxyMjNlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:18:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:18:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:18:44 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b69ee-dcd1-474e-a335-5c16c1700003]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:18:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[126ac598-2fa2-4ecb-85ca-81cfab48b8ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91] added
Nov 13 21:18:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e62c889-4303-4ee9-86a1-c7f7113c2c22]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa65e16-1e9f-49c0-99da-f8ee7dcb9265]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxyMjNlp {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxyMjNlp" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beedeae-be2b-47d5-bd21-0ab904348a1c]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uxyMjNlp'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1196d48-6887-4dd0-b74e-348cb9bace73]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bda843-25f8-4295-9669-c15f99c2771c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:18:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:18:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:18:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 21:18:44 user nova-compute[75239]: 
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c31dc1-7dd3-4a0f-a5ad-d9dfc716e3f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91, portal: 172.16.0.220,3260]
Nov 13 21:18:44 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91, portal: 172.16.0.220,3260] successful.
Nov 13 21:18:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba2ede1-3293-46d9-a3e0-596dcc4a1faa]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8416c9e7-87b7-4173-bb74-1b9c5dce4082]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 (non-flash)
Nov 13 21:18:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 (non-flash)
Nov 13 21:18:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5146654-c4b6-41c3-8670-9e6e14ff68d1]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:18:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxyMjNlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:18:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:18:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26339653338343366', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:18:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339653338343366', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:18:45 user nova-compute[75239]: DEBUG nova.objects.instance [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:18:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 21:18:45 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:18:45 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:18:45 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:18:45 user nova-compute[75239]:   <serial>5b7ed67f-1747-4fa1-a950-c922247cca91</serial>
Nov 13 21:18:45 user nova-compute[75239]: </disk>
Nov 13 21:18:45 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 21:18:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:18:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:18:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No VIF found with MAC fa:16:3e:2a:b3:21, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:18:45 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-7b2e8b0d-2c25-4dd9-b54f-e6505d2f6a35 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.838s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:18:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:18:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:18:48 user nova-compute[75239]: INFO nova.compute.manager [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Detaching volume 5b7ed67f-1747-4fa1-a950-c922247cca91
Nov 13 21:18:48 user nova-compute[75239]: INFO nova.virt.block_device [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attempting to driver detach volume 5b7ed67f-1747-4fa1-a950-c922247cca91 from mountpoint /dev/vdb
Nov 13 21:18:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Attempting to detach device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 21:18:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:18:48 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:18:48 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:18:48 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:18:48 user nova-compute[75239]:   <serial>5b7ed67f-1747-4fa1-a950-c922247cca91</serial>
Nov 13 21:18:48 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:18:48 user nova-compute[75239]: </disk>
Nov 13 21:18:48 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:18:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully detached device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the persistent domain config.
Nov 13 21:18:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 21:18:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:18:48 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:18:48 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:18:48 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:18:48 user nova-compute[75239]:   <serial>5b7ed67f-1747-4fa1-a950-c922247cca91</serial>
Nov 13 21:18:48 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:18:48 user nova-compute[75239]: </disk>
Nov 13 21:18:48 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:18:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 21:18:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:18:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:19:01 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:19:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:19:01 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:19:01 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:19:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:01 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:02 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:19:02 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9044MB free_disk=24.89739227294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 07934dee-2623-4962-ac25-cab60b8b0e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing inventories for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating ProviderTree inventory for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Updating inventory in ProviderTree for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing aggregate associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, aggregates: None {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Refreshing trait associations for resource provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4, traits: COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.437s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:19:02 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:19:03 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:03 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:19:05 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:07 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:07 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:08 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07934dee-2623-4962-ac25-cab60b8b0e8a is timed out.
Nov 13 21:19:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully detached device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the live domain config.
Nov 13 21:19:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxyMjNlp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:19:08 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[963ecdf9-92a7-4177-a10f-db1782b01218]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:19:08 user nova-compute[75239]: No targets found.
Nov 13 21:19:08 user nova-compute[75239]: iSNS:
Nov 13 21:19:08 user nova-compute[75239]: No targets found.
Nov 13 21:19:08 user nova-compute[75239]: STATIC:
Nov 13 21:19:08 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91
Nov 13 21:19:08 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:19:08 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:19:08 user nova-compute[75239]: FIRMWARE:
Nov 13 21:19:08 user nova-compute[75239]: No targets found.
Nov 13 21:19:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:19:08 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:19:08 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac72f407-5a44-4916-9f21-d3d25d7bd4c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a790a6-7541-4af5-8b13-423a0916aa70]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 (non-flash)
Nov 13 21:19:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 (non-flash)
Nov 13 21:19:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d9ec91e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf966c0-7f25-43ca-a52f-429e4191cc35]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[170b7fa1-472e-4621-a2b4-aa4768698d80]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7076cbb2-7bee-49d2-a706-65fc75abdcbc]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2322b59f-a1fa-4cf1-bd9d-51618d6c9b4c]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c75d97e-3767-44b0-8515-4c188a564887]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[36843cce-c371-4005-81a5-44f097f8bf99]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91, portal: 172.16.0.220,3260]
Nov 13 21:19:08 user nova-compute[75239]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91, portal: 172.16.0.220,3260] successful.
Nov 13 21:19:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b7ed67f-1747-4fa1-a950-c922247cca91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d475ca-2420-4052-88ee-fde0528dd416]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:19:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== disconnect_volume: return (327ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:19:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:19:09 user nova-compute[75239]: DEBUG nova.objects.instance [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:19:09 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-c1e7da35-c3bc-44cd-97cc-d52fc0ddf142 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.631s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:19:10 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:12 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:14 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 21:19:16 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:17 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:20 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:20 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Triggering sync for uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 21:19:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:19:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:19:20 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:19:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:19:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:19:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:19:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:19:22 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:19:24 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Cleaning up deleted instances {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 21:19:24 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] There are 0 instances to clean {{(pid=75239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 21:19:26 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:27 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:32 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:33 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:19:37 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG nova.objects.instance [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:19:40 user nova-compute[75239]: INFO nova.compute.manager [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attaching volume a5aab626-cba2-4568-940d-13776cac5973 to /dev/vdb
Nov 13 21:19:40 user nova-compute[75239]: DEBUG os_brick.utils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77bc96a-8bd7-47fd-a3ab-ee8c050f3016]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb47814-17b7-4037-964a-c71b03a20243]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b5fc31-7deb-46ea-88af-e0611ebad656]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dfd026-1c16-4c39-8d42-d81459b2d685]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:19:40 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:19:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c527a65-5752-4742-b5fa-9b7b4424f0ed]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG os_brick.utils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:19:40 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating existing volume attachment record: 9867d8d6-c599-4126-87c2-9e04abf12f55 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:19:42 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:19:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glYJrDtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:19:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:19:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:19:44 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc87178d-df5f-4652-864e-4c4756cb369a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:19:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf6dee-7f1f-4040-9474-8b0595aaa6be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973] added
Nov 13 21:19:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a3f0c-840b-4db1-b3c9-81e65e7cbfd9]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a0a8c6-2c53-4d1d-9c56-28a8a3219e1e]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glYJrDtO {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glYJrDtO" returned: 0 in 0.030s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e453facd-3be2-4229-8ae0-92991e57248a]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'glYJrDtO'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e3866a-c95e-42d2-a26d-6213516c9777]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82317b1-757b-459c-9457-b05ea72864c1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:19:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:19:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:19:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 21:19:44 user nova-compute[75239]: 
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d041c799-704c-4611-a3b2-7128d217f391]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973, portal: 172.16.0.220,3260]
Nov 13 21:19:44 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973, portal: 172.16.0.220,3260] successful.
Nov 13 21:19:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d106234-26b2-45ec-8cb6-1e164f53f0fb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01ec4d5-a026-485a-9a79-5d73c40c943d]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 (non-flash)
Nov 13 21:19:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 (non-flash)
Nov 13 21:19:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9605a162-29da-4049-9e16-2ee839b29194]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:19:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glYJrDtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:19:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:19:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23962363333633662', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:19:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962363333633662', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:19:45 user nova-compute[75239]: DEBUG nova.objects.instance [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:19:45 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 21:19:45 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:19:45 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:19:45 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:19:45 user nova-compute[75239]:   <serial>a5aab626-cba2-4568-940d-13776cac5973</serial>
Nov 13 21:19:45 user nova-compute[75239]: </disk>
Nov 13 21:19:45 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 21:19:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:19:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:19:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No VIF found with MAC fa:16:3e:2a:b3:21, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:19:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-01fadc62-9830-4089-bb26-b97f742fe2f7 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.867s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:19:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:19:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:19:48 user nova-compute[75239]: INFO nova.compute.manager [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Detaching volume a5aab626-cba2-4568-940d-13776cac5973
Nov 13 21:19:48 user nova-compute[75239]: INFO nova.virt.block_device [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attempting to driver detach volume a5aab626-cba2-4568-940d-13776cac5973 from mountpoint /dev/vdb
Nov 13 21:19:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Attempting to detach device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 21:19:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:19:48 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:19:48 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:19:48 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:19:48 user nova-compute[75239]:   <serial>a5aab626-cba2-4568-940d-13776cac5973</serial>
Nov 13 21:19:48 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:19:48 user nova-compute[75239]: </disk>
Nov 13 21:19:48 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:19:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully detached device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the persistent domain config.
Nov 13 21:19:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 21:19:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:19:48 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:19:48 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:19:48 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:19:48 user nova-compute[75239]:   <serial>a5aab626-cba2-4568-940d-13776cac5973</serial>
Nov 13 21:19:48 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:19:48 user nova-compute[75239]: </disk>
Nov 13 21:19:48 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:19:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 21:19:52 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:19:57 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:03 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:20:03 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:20:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9034MB free_disk=24.896411895751953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 07934dee-2623-4962-ac25-cab60b8b0e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:20:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:20:08 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07934dee-2623-4962-ac25-cab60b8b0e8a is timed out.
Nov 13 21:20:08 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully detached device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the live domain config.
Nov 13 21:20:08 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glYJrDtO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:20:08 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:20:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[24902f3c-940a-4713-8562-ae02537ec0e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:20:08 user nova-compute[75239]: No targets found.
Nov 13 21:20:08 user nova-compute[75239]: iSNS:
Nov 13 21:20:08 user nova-compute[75239]: No targets found.
Nov 13 21:20:08 user nova-compute[75239]: STATIC:
Nov 13 21:20:08 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973
Nov 13 21:20:08 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:20:08 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:20:08 user nova-compute[75239]: FIRMWARE:
Nov 13 21:20:08 user nova-compute[75239]: No targets found.
Nov 13 21:20:08 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:20:08 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:20:08 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:20:08 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e82600-4f4c-4722-9309-cff06e9285a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[049acaa6-260e-4178-b3cc-7789c8a95578]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 (non-flash)
Nov 13 21:20:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 (non-flash)
Nov 13 21:20:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605af9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8558e31d-0645-469c-a97d-408a79494236]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cb91c7-f3f7-4539-995c-90c11b5e2b13]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4abfc4-25cf-425b-b1b8-53222d19ced2]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e652d1e-2ef3-4a20-9a6a-b1a5ef62117e]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b1cbd8-8148-488b-9932-b9fcdb60db67]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f78524b-0b36-4728-b5f1-088c53344ff1]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973, portal: 172.16.0.220,3260]
Nov 13 21:20:09 user nova-compute[75239]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973, portal: 172.16.0.220,3260] successful.
Nov 13 21:20:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5aab626-cba2-4568-940d-13776cac5973 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc882e6-a3c0-42b6-b1c6-285c7f47f181]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== disconnect_volume: return (313ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:20:09 user nova-compute[75239]: DEBUG nova.objects.instance [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:20:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-464a4da0-1da5-4187-bbfb-d0e2cd1d7b90 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.625s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:20:10 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:20:11 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:20:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:20:14 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:20:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:20:17 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:20:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:20:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:20:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:20:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:20:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:20:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:20:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:20:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:20:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:20:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:20:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:20:40 user nova-compute[75239]: INFO nova.compute.manager [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attaching volume c6ad295a-f316-445c-9f57-e40338ae5ec2 to /dev/vdb
Nov 13 21:20:40 user nova-compute[75239]: DEBUG os_brick.utils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[536de72d-feb0-4b2d-b001-ae04886c5c78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:911a1d1759ce\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d48bc4e-e357-4986-b578-b1afeb360beb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ea82a3-fdb9-4448-bc4b-ecef8cfd186e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bb602f-558c-4df9-821b-2faf43a8ba2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:40 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Running cmd (subprocess): nvme version {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] 'nvme version' failed. Not Retrying. {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:20:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] nvme not present on system {{(pid=75239) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 21:20:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:41 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 21:20:41 user nova-compute[75239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 21:20:41 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6db71b2-80c0-4895-9a58-d68e8a5a9fa9]: (4, '') {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75239) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 21:20:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 21:20:41 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.lightos [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] LIGHTOS: no hostnqn found. {{(pid=75239) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 21:20:41 user nova-compute[75239]: DEBUG os_brick.utils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:911a1d1759ce', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:20:41 user nova-compute[75239]: DEBUG nova.virt.block_device [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating existing volume attachment record: 39f952b0-5ccd-4ca1-9490-ec3ec79d8183 {{(pid=75239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 21:20:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:20:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Calling os-brick to attach iSCSI Volume {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHNSTtpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:20:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:20:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:20:44 user nova-compute[75239]: INFO os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[642274e1-4464-46b3-ae56-3263e44237c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 21:20:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eff4cbe-f6c3-4d81-92c4-de0fa8b393cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2] added\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2] added
Nov 13 21:20:44 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fb3498-bb62-43c4-89f9-b96f91641e66]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3829ecc-af6a-4efc-899e-25717114ada0]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHNSTtpZ {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHNSTtpZ" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f997ac02-e092-4ee4-a798-92700ce58b30]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHNSTtpZ'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[43add544-ddb1-4333-a986-a0240dff55e6]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cca105-59b6-4569-aca3-15c99ae18a90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:20:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:20:44 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 21:20:44 user nova-compute[75239]:  {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:20:44 user nova-compute[75239]: WARNING os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 21:20:44 user nova-compute[75239]: 
Nov 13 21:20:44 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --login {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[15220594-c8e8-47ac-91ed-7a1dc53c46a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2, portal: 172.16.0.220,3260]
Nov 13 21:20:45 user nova-compute[75239]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2, portal: 172.16.0.220,3260] successful.
Nov 13 21:20:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f53a90-d877-4aba-ae54-1a034da7f1bb]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f2582b-1dca-4b1f-859a-1cc939dd8aad]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 (non-flash)
Nov 13 21:20:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 (non-flash)
Nov 13 21:20:45 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Connected to 172.16.0.220:3260 {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75239) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75239) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[980b1f43-fe8e-4460-a5ab-8d144512d98a]: (4, ('- - 0', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75239) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 21:20:45 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHNSTtpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75239) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 21:20:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:20:46 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26239313639326632', 'path': '/dev/sdb'} {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:20:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239313639326632', 'path': '/dev/sdb'} {{(pid=75239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 21:20:46 user nova-compute[75239]: DEBUG nova.objects.instance [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:20:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 21:20:46 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:20:46 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:20:46 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:20:46 user nova-compute[75239]:   <serial>c6ad295a-f316-445c-9f57-e40338ae5ec2</serial>
Nov 13 21:20:46 user nova-compute[75239]: </disk>
Nov 13 21:20:46 user nova-compute[75239]:  {{(pid=75239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 21:20:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No BDM found with device name vda, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:20:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 21:20:46 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] No VIF found with MAC fa:16:3e:2a:b3:21, not building metadata {{(pid=75239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 21:20:46 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-b6389c87-4a4a-40d8-85e6-a4199968b3b2 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.825s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:20:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:20:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:20:49 user nova-compute[75239]: INFO nova.compute.manager [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Detaching volume c6ad295a-f316-445c-9f57-e40338ae5ec2
Nov 13 21:20:49 user nova-compute[75239]: INFO nova.virt.block_device [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Attempting to driver detach volume c6ad295a-f316-445c-9f57-e40338ae5ec2 from mountpoint /dev/vdb
Nov 13 21:20:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Attempting to detach device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the persistent domain config. {{(pid=75239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 21:20:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:20:49 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:20:49 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:20:49 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:20:49 user nova-compute[75239]:   <serial>c6ad295a-f316-445c-9f57-e40338ae5ec2</serial>
Nov 13 21:20:49 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:20:49 user nova-compute[75239]: </disk>
Nov 13 21:20:49 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:20:49 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully detached device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the persistent domain config.
Nov 13 21:20:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the live domain config. {{(pid=75239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 21:20:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.guest [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 21:20:49 user nova-compute[75239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 21:20:49 user nova-compute[75239]:   <source dev="/dev/sdb"/>
Nov 13 21:20:49 user nova-compute[75239]:   <target dev="vdb" bus="virtio"/>
Nov 13 21:20:49 user nova-compute[75239]:   <serial>c6ad295a-f316-445c-9f57-e40338ae5ec2</serial>
Nov 13 21:20:49 user nova-compute[75239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 21:20:49 user nova-compute[75239]: </disk>
Nov 13 21:20:49 user nova-compute[75239]:  {{(pid=75239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 21:20:49 user nova-compute[75239]: DEBUG nova.virt.libvirt.driver [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 21:20:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:20:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:02 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75239) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:03 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:21:03 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:21:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9031MB free_disk=24.895488739013672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Instance 07934dee-2623-4962-ac25-cab60b8b0e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:21:03 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:21:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:09 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 07934dee-2623-4962-ac25-cab60b8b0e8a is timed out.
Nov 13 21:21:09 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully detached device vdb from instance 07934dee-2623-4962-ac25-cab60b8b0e8a from the live domain config.
Nov 13 21:21:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] calling os-brick to detach iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2d844ce020>, {'target_iqn': 'iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHNSTtpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 21:21:09 user nova-compute[75239]: WARNING os_brick.initiator.connectors.base [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0798c58e-bcc7-49a8-acc2-ba05ec498c8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 21:21:09 user nova-compute[75239]: No targets found.
Nov 13 21:21:09 user nova-compute[75239]: iSNS:
Nov 13 21:21:09 user nova-compute[75239]: No targets found.
Nov 13 21:21:09 user nova-compute[75239]: STATIC:
Nov 13 21:21:09 user nova-compute[75239]: Target: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2
Nov 13 21:21:09 user nova-compute[75239]:         Portal: 172.16.0.220:3260,-1
Nov 13 21:21:09 user nova-compute[75239]:                 Iface Name: default
Nov 13 21:21:09 user nova-compute[75239]: FIRMWARE:
Nov 13 21:21:09 user nova-compute[75239]: No targets found.
Nov 13 21:21:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 21:21:09 user nova-compute[75239]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 21:21:09 user nova-compute[75239]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75239) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2', 0)] {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6954c3ee-34d9-4da4-b16b-9c7be7329000]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a459181-e231-4d40-aed4-4c2847320361]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 (non-flash)\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 (non-flash)
Nov 13 21:21:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 (non-flash)
Nov 13 21:21:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2d605acca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2'): ({'sdb'}, set())}) {{(pid=75239) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Removing single pathed devices sdb {{(pid=75239) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[509cd901-eecf-4b3d-8902-dcda3207eea4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[775f2945-3728-4501-87bf-ae72ad0a19a7]: (4, ('ok\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Flushing IO for device /dev/sdb {{(pid=75239) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e23c1e3-f17d-4b59-8a27-5bb299425368]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75239) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e6c8af-2bc6-46fa-adb4-0ff26394553b]: (4, ('1', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.linuxscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] SCSI volumes sdb have been removed. {{(pid=75239) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2')] {{(pid=75239) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe0e485-4ea9-4ad4-9e2b-b574e1eb5557]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --logout {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4f04e1-18f7-4f94-b578-39e44eaf29b0]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2, portal: 172.16.0.220,3260]
Nov 13 21:21:09 user nova-compute[75239]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2, portal: 172.16.0.220,3260] successful.
Nov 13 21:21:09 user nova-compute[75239]:  stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op delete {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6ad295a-f316-445c-9f57-e40338ae5ec2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86402) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af620bc-e2f3-4a68-bca2-bf7375ff1d13]: (4, ('', '')) {{(pid=86402) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75239) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.base [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG os_brick.initiator.connectors.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] <== disconnect_volume: return (285ms) None {{(pid=75239) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 21:21:09 user nova-compute[75239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Disconnected iSCSI Volume {{(pid=75239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 21:21:10 user nova-compute[75239]: DEBUG nova.objects.instance [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'flavor' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:21:10 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-576b2938-1b1e-4749-9b5b-f86450da21fd tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.607s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:21:11 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:21:13 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquired lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Forcefully refreshing network info cache for instance {{(pid=75239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG nova.objects.instance [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lazy-loading 'info_cache' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG nova.network.neutron [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [{"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Releasing lock "refresh_cache-07934dee-2623-4962-ac25-cab60b8b0e8a" {{(pid=75239) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 21:21:15 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updated the network info_cache for instance {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 21:21:16 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:17 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:21:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:21:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:21:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:21:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:21:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:21:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:21:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:21:33 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:21:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:21:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:21:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:21:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:21:47 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:21:47 user nova-compute[75239]: INFO nova.compute.manager [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Terminating instance
Nov 13 21:21:47 user nova-compute[75239]: DEBUG nova.compute.manager [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Start destroying the instance on the hypervisor. {{(pid=75239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 21:21:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:47 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-ed89571a-8cd9-401d-aee1-3ab831f1c1cd req-92f2b10f-9f52-4061-a358-ad645f221c75 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received event network-vif-unplugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ed89571a-8cd9-401d-aee1-3ab831f1c1cd req-92f2b10f-9f52-4061-a358-ad645f221c75 service nova] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ed89571a-8cd9-401d-aee1-3ab831f1c1cd req-92f2b10f-9f52-4061-a358-ad645f221c75 service nova] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-ed89571a-8cd9-401d-aee1-3ab831f1c1cd req-92f2b10f-9f52-4061-a358-ad645f221c75 service nova] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-ed89571a-8cd9-401d-aee1-3ab831f1c1cd req-92f2b10f-9f52-4061-a358-ad645f221c75 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] No waiting events found dispatching network-vif-unplugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG nova.compute.manager [req-ed89571a-8cd9-401d-aee1-3ab831f1c1cd req-92f2b10f-9f52-4061-a358-ad645f221c75 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received event network-vif-unplugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca for instance with task_state deleting. {{(pid=75239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [-] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Instance destroyed successfully.
Nov 13 21:21:48 user nova-compute[75239]: DEBUG nova.objects.instance [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lazy-loading 'resources' on Instance uuid 07934dee-2623-4962-ac25-cab60b8b0e8a {{(pid=75239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG nova.virt.libvirt.vif [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T21:15:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-360554333',display_name='tempest-SnapshotDataIntegrityTests-server-360554333',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-360554333',id=53,image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKUdHgSRij2/T1CSZG63TWY2p2ozdE8vtgvjn/mq7WtjcnrBRpU2cMUMYbhg5SOoQjvk9F0BLFoEOeXHrTmygY+GWxRZLaTq8JG/CvXc5ANM48yZ868hpUh+8UrktgTiw==',key_name='tempest-keypair-759221340',keypairs=<?>,launch_index=0,launched_at=2023-11-13T21:15:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cbfea5dd14e547abb7cbc71a88c73a2c',ramdisk_id='',reservation_id='r-c74ys1kn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='800ade11-c0e2-452c-9cf5-70051593ac8f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1805382459',owner_user_name='tempest-SnapshotDataIntegrityTests-1805382459-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T21:15:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4106d86f6848433d939b67c169a8a43f',uuid=07934dee-2623-4962-ac25-cab60b8b0e8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Converting VIF {"id": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "address": "fa:16:3e:2a:b3:21", "network": {"id": "aab9279a-ea88-4764-a960-e947db94748d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1075118998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbfea5dd14e547abb7cbc71a88c73a2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96db4cf0-5b", "ovs_interfaceid": "96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG nova.network.os_vif_util [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b3:21,bridge_name='br-int',has_traffic_filtering=True,id=96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca,network=Network(aab9279a-ea88-4764-a960-e947db94748d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96db4cf0-5b') {{(pid=75239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG os_vif [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b3:21,bridge_name='br-int',has_traffic_filtering=True,id=96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca,network=Network(aab9279a-ea88-4764-a960-e947db94748d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96db4cf0-5b') {{(pid=75239) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96db4cf0-5b, bridge=br-int, if_exists=True) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d92f67c-39b5-407f-bba1-63ce55ef25a1) {{(pid=75239) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:21:48 user nova-compute[75239]: INFO os_vif [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:b3:21,bridge_name='br-int',has_traffic_filtering=True,id=96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca,network=Network(aab9279a-ea88-4764-a960-e947db94748d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96db4cf0-5b')
Nov 13 21:21:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Deleting instance files /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a_del
Nov 13 21:21:48 user nova-compute[75239]: INFO nova.virt.libvirt.driver [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Deletion of /opt/stack/data/nova/instances/07934dee-2623-4962-ac25-cab60b8b0e8a_del complete
Nov 13 21:21:48 user nova-compute[75239]: INFO nova.compute.manager [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 21:21:48 user nova-compute[75239]: DEBUG oslo.service.loopingcall [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75239) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG nova.compute.manager [-] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Deallocating network for instance {{(pid=75239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 21:21:48 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] deallocate_for_instance() {{(pid=75239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 21:21:49 user nova-compute[75239]: DEBUG nova.network.neutron [-] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Updating instance_info_cache with network_info: [] {{(pid=75239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 21:21:49 user nova-compute[75239]: INFO nova.compute.manager [-] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Took 0.83 seconds to deallocate network for instance.
Nov 13 21:21:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:21:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:21:49 user nova-compute[75239]: DEBUG nova.compute.manager [req-cca607b2-96c3-4b8a-8ee3-e12a4a8353a7 req-31212945-c047-41df-85f5-3a1cedd1947a service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received event network-vif-deleted-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:21:49 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:21:49 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:21:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:21:49 user nova-compute[75239]: INFO nova.scheduler.client.report [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Deleted allocations for instance 07934dee-2623-4962-ac25-cab60b8b0e8a
Nov 13 21:21:49 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-26f642c2-d601-467d-9539-abbe54b1f2b5 tempest-SnapshotDataIntegrityTests-1805382459 tempest-SnapshotDataIntegrityTests-1805382459-project-member] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.012s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:21:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-aa89763c-ea0d-41fc-8e9b-9b51e59e23ae req-3aa3165b-6f61-4990-adbd-d3cae5a0f028 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received event network-vif-plugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 21:21:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-aa89763c-ea0d-41fc-8e9b-9b51e59e23ae req-3aa3165b-6f61-4990-adbd-d3cae5a0f028 service nova] Acquiring lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:21:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-aa89763c-ea0d-41fc-8e9b-9b51e59e23ae req-3aa3165b-6f61-4990-adbd-d3cae5a0f028 service nova] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:21:50 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [req-aa89763c-ea0d-41fc-8e9b-9b51e59e23ae req-3aa3165b-6f61-4990-adbd-d3cae5a0f028 service nova] Lock "07934dee-2623-4962-ac25-cab60b8b0e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:21:50 user nova-compute[75239]: DEBUG nova.compute.manager [req-aa89763c-ea0d-41fc-8e9b-9b51e59e23ae req-3aa3165b-6f61-4990-adbd-d3cae5a0f028 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] No waiting events found dispatching network-vif-plugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca {{(pid=75239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 21:21:50 user nova-compute[75239]: WARNING nova.compute.manager [req-aa89763c-ea0d-41fc-8e9b-9b51e59e23ae req-3aa3165b-6f61-4990-adbd-d3cae5a0f028 service nova] [instance: 07934dee-2623-4962-ac25-cab60b8b0e8a] Received unexpected event network-vif-plugged-96db4cf0-5b13-4bb9-bfd5-1d2c1e2e77ca for instance with vm_state deleted and task_state None.
Nov 13 21:21:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:21:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:22:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 21:22:04 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:22:04 user nova-compute[75239]: WARNING nova.virt.libvirt.driver [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 21:22:04 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Hypervisor/Node resource view: name=user free_ram=9154MB free_disk=24.922607421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG nova.compute.provider_tree [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed in ProviderTree for provider: 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 {{(pid=75239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG nova.scheduler.client.report [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Inventory has not changed for provider 6c1abe79-622f-4b7b-89fd-35e20ccec6d4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Compute_service record updated for user:user {{(pid=75239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 21:22:04 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:22:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:22:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:22:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:22:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:22:08 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:10 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:22:11 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:22:13 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:22:13 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:22:13 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:22:17 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:22:17 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:22:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Starting heal instance info cache {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 21:22:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Rebuilding the list of instances to heal {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 21:22:17 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Didn't find any instances for network info cache update. {{(pid=75239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 21:22:18 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:22:18 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:22:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:22:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75239) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 21:22:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:22:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75239) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 21:22:23 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:28 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:33 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:22:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:38 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:41 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:43 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:44 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:48 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:22:53 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 21:22:58 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:23:03 user nova-compute[75239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75239) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 21:23:04 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:23:04 user nova-compute[75239]: DEBUG nova.compute.manager [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 21:23:06 user nova-compute[75239]: DEBUG oslo_service.periodic_task [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75239) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 21:23:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 21:23:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 21:23:06 user nova-compute[75239]: DEBUG oslo_concurrency.lockutils [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75239) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 21:23:06 user nova-compute[75239]: DEBUG nova.compute.resource_tracker [None req-a427ddc3-9188-4ce8-a5d1-ca975b1d1421 None None] Auditing locally available compute resources for user (node: user) {{(pid=75239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}